00000001:02000400:3.0F:1789049805.837769:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789049816.408330:0:3159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789049818.351519:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 542 MB/s 00000001:01000000:2.0:1789049818.602365:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 633 MB/s 00000001:01000000:3.0:1789049818.852389:0:3221:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5359 MB/s 00000020:02000000:2.0:1789049819.714778:0:3251:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g3ed9deb 00000400:02000000:2.0:1789049820.769565:0:3266:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.101@tcp [8/256/0/180] 00008000:02000000:0.0:1789049824.693185:0:3415:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789049871.763581:0:5222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789049881.673060:0:5797:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789049881.673068:0:5797:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789049881.673254:0:5797:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d6d5c378 00000080:02000400:0.0:1789049881.675403:0:5797:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789049881.680383:0:5797:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789049881.680401:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789049881.680448:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e387579e) 00000020:00000080:0.0:1789049881.680471:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1789049881.696515:0:5797:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789049881.697056:0:5797:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789049881.724559:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789049881.724613:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789049881.724637:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789049881.724690:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789049881.724717:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789049881.725085:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789049881.725093:0:5797:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789049881.725106:0:5797:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b78725 00000020:01000004:2.0:1789049881.725114:0:5797:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789049881.725119:0:5797:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789049881.725124:0:5797:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d6d5c378 from MGS 00000020:01000004:2.0:1789049881.725129:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789049881.725152:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bd52cde1) 00000020:00000080:2.0:1789049881.725164:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789049881.725306:0:5797:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d5c378 from MGS, refs=2 00080000:01000000:2.0:1789049881.725313:0:5797:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789049881.725320:0:5797:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b78733 00000100:00100000:2.0:1789049881.725412:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789049881.725541:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789049881.725548:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789049881.728904:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789049881.728923:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789049881.730628:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049881.730853:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789049881.730861:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789049881.742868:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789049881.742888:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789049881.743652:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789049881.743661:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789049881.744620:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049881.744624:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049881.744626:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049881.744976:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049881.744978:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049881.744979:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049881.745786:0:5797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789049881.758141:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789049881.999478:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2051 MB/s 00000001:01000000:2.0:1789049882.249319:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2527 MB/s 00000001:01000000:2.0:1789049882.500661:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 458 MB/s 00000001:01000000:2.0:1789049882.753485:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 785 MB/s 00080000:10000000:2.0:1789049882.767071:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1789049882.770838:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789049882.803631:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789049882.803649:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789049882.803652:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789049882.816049:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789049882.817536:0:5797:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789049882.817629:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789049882.817933:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789049882.817961:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789049882.818759:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.818932:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789049882.818939:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789049882.819832:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789049882.819841:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789049882.828179:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789049882.828197:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789049882.845395:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789049882.845427:0:5797:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.101@tcp' 00000020:01000004:0.0:1789049882.845428:0:5797:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1789049882.845437:0:5813:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1789049882.845487:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.101@tcp (typ=mgc) 00000020:00000080:0.0:1789049882.845500:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.101@tcp (000000007f9570e8) 00000020:00000080:0.0:1789049882.845519:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789049882.845622:0:5797:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000004a968b7@MGC192.168.206.101@tcp: add connection 192.168.206.101@tcp at head 00010000:00010000:0.0:1789049882.845836:0:5797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.101@tcp-0 is initialized 00000040:01000000:0.0:1789049882.845842:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789049882.848911:0:5815:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789049882.848957:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.101@tcp (uuid 4c5df17a-77a5-4faa-ab5f-0191afbe3474) 00000020:00000080:2.0:1789049882.848979:0:5797:0:(genops.c:1384:class_connect()) connect: client 4c5df17a-77a5-4faa-ab5f-0191afbe3474, cookie 0x9df728c939b78741 00000100:00080000:2.0:1789049882.848991:0:5797:0:(import.c:545:import_select_connection()) MGC192.168.206.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049882.848999:0:5797:0:(import.c:666:import_select_connection()) MGC192.168.206.101@tcp: import 0000000004a968b7 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789049882.849038:0:5797:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000518e59d9 x1875954704056448/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049882.849058:0:5797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4c5df17a-77a5-4faa-ab5f-0191afbe3474->MGS 00000020:01000004:2.0:1789049882.849076:0:5797:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789049882.849080:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789049882.849094:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bb9221d0) 00000020:00000080:2.0:1789049882.849106:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789049882.853684:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000518e59d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3281:1875954704056448:0@lo:250: 00000100:00100000:1.0:1789049882.853783:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049882.855731:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056448 00000100:00100000:3.0:1789049882.855746:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056448 00000100:00100000:3.0:1789049882.855792:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049882.855799:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d8720f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3281:x1875954704056448:12345-0@lo:250: 00010000:00080000:3.0:1789049882.855826:0:5810:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4c5df17a-77a5-4faa-ab5f-0191afbe3474@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:3.0:1789049882.855854:0:5810:0:(genops.c:1384:class_connect()) connect: client 4c5df17a-77a5-4faa-ab5f-0191afbe3474, cookie 0x9df728c939b7874f 00000100:00080000:3.0:1789049882.855979:0:5810:0:(import.c:65:import_set_state_nolock()) 00000000fda4e1ba : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049882.856076:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d8720f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:3281:x1875954704056448:12345-0@lo:250: Request processed in 276us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049882.856084:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049882.859862:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049882.860101:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789049882.860108:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789049882.862347:0:3281:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789049882.862366:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.101@tcp: connect to target with instance 0 00000100:00080000:1.0:1789049882.862374:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789049882.862379:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789049882.862382:0:3281:0:(import.c:65:import_set_state_nolock()) 0000000004a968b7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789049882.862386:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789049882.862399:0:3281:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789049882.862406:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000518e59d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3281:1875954704056448:0@lo:250: 00000100:00100000:1.0:1789049882.865756:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789049882.865770:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789049882.867474:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789049882.867484:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789049882.868880:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049882.869052:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789049882.869057:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789049882.872390:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789049882.872406:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789049882.909694:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.909920:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789049882.909927:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789049882.912511:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789049882.912622:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789049882.913691:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.913875:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789049882.913880:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789049882.920098:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049882.920116:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789049882.921892:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.922121:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789049882.922133:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789049882.923185:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049882.923195:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789049882.923895:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.924069:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789049882.924126:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789049882.925019:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049882.925028:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789049882.956499:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049882.956744:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049882.956750:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789049882.958103:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049882.958115:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789049882.959500:0:5797:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049882.959514:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789049882.960102:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789049882.960124:0:5797:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789049882.960130:0:5797:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789049882.960331:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789049882.960372:0:5797:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789049882.960377:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789049882.960378:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049882.960380:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049882.960381:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049882.960382:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049882.960383:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049882.960384:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049882.960386:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049882.960387:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049882.960388:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049882.960389:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049882.960391:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049882.960393:0:5797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789049882.960395:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049882.960396:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049882.960397:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049882.960398:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049882.960399:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049882.960400:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049882.960401:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049882.960402:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049882.960408:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049882.960409:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049882.960410:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049882.960410:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049882.960441:0:5797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049882.960456:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d25c1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056576:0@lo:253: 00000100:00100000:3.0:1789049882.960525:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049882.960627:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8dd708d going to sleep for 11 seconds 00000100:00100000:0.0:1789049882.960685:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056576 00000100:00100000:0.0:1789049882.960692:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056576 00000100:00100000:0.0:1789049882.960774:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049882.960782:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d42a6159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5797:x1875954704056576:12345-0@lo:253: 20000000:01000000:0.0:1789049882.960823:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789049882.960825:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789049882.961619:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789049882.961677:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789049882.961984:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049882.962902:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789049882.963137:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789049882.963141:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789049882.963145:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789049882.963148:0:5812:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789049882.963160:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789049882.963532:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049882.963775:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789049882.963789:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789049882.963838:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789049882.963889:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789049882.963926:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789049882.964018:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789049882.964026:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789049882.964074:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789049882.964081:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789049882.964114:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789049882.964122:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789049882.964151:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789049882.964531:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789049882.964581:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789049882.964587:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789049882.964614:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049882.964838:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789049882.964849:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789049882.964886:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789049882.964922:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789049882.964970:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789049882.964982:0:5812:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789049882.965054:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789049882.965064:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789049882.965105:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789049882.965143:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789049882.965176:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789049882.965187:0:5812:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789049882.965398:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789049882.965407:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789049882.965441:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789049882.965477:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789049882.965657:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789049882.965710:0:5812:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789049882.965717:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789049882.966179:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789049882.966660:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789049882.966683:0:5812:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.101@tcp for mdt 20000000:01000000:0.0:1789049882.966685:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.101@tcp (null) (null) (null) 00000040:00080000:0.0:1789049882.966722:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789049882.966729:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789049882.966760:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789049882.966768:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.101@tcp (null) (null) 00000040:00080000:0.0:1789049882.966813:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789049882.966823:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789049882.966856:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789049882.966906:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789049882.966972:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789049882.966976:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789049882.966979:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789049882.966990:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789049882.966992:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789049882.967021:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789049882.967023:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789049882.967579:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789049882.967791:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789049882.967832:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789049882.967890:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789049882.967903:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789049882.967905:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789049882.968308:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789049882.968507:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789049882.968546:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789049882.968594:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789049882.968609:0:5812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049882.968611:0:5812:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789049882.968616:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789049882.968618:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789049882.968623:0:5812:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789049882.968629:0:5812:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789049882.969014:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789049882.969138:0:5812:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789049882.979844:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789049882.979898:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789049882.979973:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789049882.979993:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789049882.980011:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980025:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980051:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980057:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980063:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980069:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980724:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000928c47fb already unused, calling callback (0000000068404a19) 00010000:00010000:0.0:1789049882.980729:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980737:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980749:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980756:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049882.980762:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000928c47fb/0x9df728c939b78756 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049882.980785:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789049883.358832:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d42a6159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5797:x1875954704056576:12345-0@lo:253: Request processed in 398041us (398298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049883.358870:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049883.362287:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d25c1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056576:0@lo:253: 10000000:01000000:3.0:1789049883.362310:0:5797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049883.362313:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049883.362315:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049883.362316:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049883.362317:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789049883.362318:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049883.362319:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049883.362320:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049883.362322:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049883.362323:0:5797:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789049883.362324:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049883.362326:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789049883.362352:0:5797:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d6d5c378 from lustre-MDT0000 10000000:01000000:3.0:1789049883.362381:0:5797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789049883.362383:0:5797:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789049883.362387:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff950706403380 10000000:01000000:3.0:1789049883.362391:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049883.362399:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff950706403380 from 1 10000000:01000000:3.0:1789049883.362402:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789049883.362438:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049883.362448:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049883.362476:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049883.362493:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d25c1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056704:0@lo:101: 00000100:00100000:3.0:1789049883.362568:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049883.362631:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4f8a805 going to sleep for 11 seconds 00000100:00100000:0.0:1789049883.363306:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056704 00000100:00100000:0.0:1789049883.363315:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056704 00000100:00100000:0.0:1789049883.363367:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049883.363374:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000943e84bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5797:x1875954704056704:12345-0@lo:101: 00010000:00010000:0.0:1789049883.363387:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049883.363399:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000928c47fb/0x9df728c939b78764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7875d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.363421:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000928c47fb/0x9df728c939b78764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7875d expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.363431:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000928c47fb/0x9df728c939b78764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7875d expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.363438:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000928c47fb, rc 0) 00000100:00100000:0.0:1789049883.363491:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000943e84bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5797:x1875954704056704:12345-0@lo:101: Request processed in 117us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049883.363498:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049883.363595:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d25c1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056704:0@lo:101: 00010000:00010000:1.0:1789049883.363609:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.363617:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049883.363693:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056832:0@lo:501: 00000100:00100000:1.0:1789049883.363721:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.363753:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000513d5ea2 going to sleep for 11 seconds 00000100:00100000:0.0:1789049883.364106:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056832 00000100:00100000:0.0:1789049883.364112:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056832 00000100:00100000:0.0:1789049883.364155:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049883.364162:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009897714f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5797:x1875954704056832:12345-0@lo:501: 00000100:00100000:0.0:1789049883.364415:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009897714f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5797:x1875954704056832:12345-0@lo:501: Request processed in 254us (693us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049883.364422:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049883.364576:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056832:0@lo:501: 10000000:01000000:1.0:1789049883.364608:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789049883.364634:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.364642:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 00000000a67ad53a/0x9df728c939b7875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049883.364650:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff950707961800 10000000:01000000:1.0:1789049883.364655:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049883.364659:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff950707961800 10000000:01000000:1.0:1789049883.364661:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789049883.364664:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff950707961800 from 1 10000000:01000000:1.0:1789049883.364666:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789049883.364688:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.364696:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.364704:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049883.364715:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056960:0@lo:101: 00000100:00100000:1.0:1789049883.364740:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.364759:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000513d5ea2 going to sleep for 11 seconds 00000100:00100000:3.0:1789049883.364828:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704056960 00000100:00100000:3.0:1789049883.364834:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704056960 00000100:00100000:3.0:1789049883.364870:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049883.364876:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bb892d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5797:x1875954704056960:12345-0@lo:101: 00010000:00010000:3.0:1789049883.364884:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049883.364895:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004265fa26/0x9df728c939b78772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7876b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049883.364911:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004265fa26/0x9df728c939b78772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7876b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049883.364919:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004265fa26/0x9df728c939b78772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7876b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049883.364926:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004265fa26, rc 0) 00000100:00100000:3.0:1789049883.364954:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bb892d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+7:5797:x1875954704056960:12345-0@lo:101: Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049883.364960:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049883.365038:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704056960:0@lo:101: 00010000:00010000:1.0:1789049883.365049:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.365067:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049883.365078:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789049883.365081:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.365087:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 000000000e222fb6/0x9df728c939b7876b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049883.365093:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789049883.365096:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049883.365100:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff950707961800 10000000:01000000:1.0:1789049883.365102:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789049883.365105:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789049883.365107:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789049883.365118:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.365124:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.365142:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049883.365155:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057088:0@lo:101: 00000100:00100000:1.0:1789049883.365180:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.365232:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000513d5ea2 going to sleep for 11 seconds 00000100:00100000:0.0:1789049883.365353:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057088 00000100:00100000:0.0:1789049883.365357:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057088 00000100:00100000:0.0:1789049883.365394:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049883.365400:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ecdf648f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+7:5797:x1875954704057088:12345-0@lo:101: 00010000:00010000:0.0:1789049883.365408:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049883.365416:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da197c45/0x9df728c939b78780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78779 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.365429:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da197c45/0x9df728c939b78780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78779 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.365436:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da197c45/0x9df728c939b78780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78779 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049883.365442:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da197c45, rc 0) 00000100:00100000:0.0:1789049883.365471:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ecdf648f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+8:5797:x1875954704057088:12345-0@lo:101: Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049883.365477:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049883.365602:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057088:0@lo:101: 00010000:00010000:1.0:1789049883.365613:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049883.365620:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049883.365660:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057216:0@lo:501: 00000100:00100000:1.0:1789049883.365684:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.365704:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000513d5ea2 going to sleep for 11 seconds 00000100:00100000:0.0:1789049883.365755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057216 00000100:00100000:0.0:1789049883.365760:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057216 00000100:00100000:0.0:1789049883.365788:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049883.365793:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001431faac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+8:5797:x1875954704057216:12345-0@lo:501: 00000100:00100000:0.0:1789049883.365994:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001431faac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5797:x1875954704057216:12345-0@lo:501: Request processed in 201us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049883.366002:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049883.366140:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057216:0@lo:501: 00000100:00100000:1.0:1789049883.366173:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057344:0@lo:503: 00000100:00100000:1.0:1789049883.366259:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.366279:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000513d5ea2 going to sleep for 11 seconds 00000100:00100000:0.0:1789049883.368163:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057344 00000100:00100000:0.0:1789049883.368179:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057344 00000100:00100000:0.0:1789049883.368269:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049883.368277:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007428f6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5797:x1875954704057344:12345-0@lo:503: 00000100:00100000:0.0:1789049883.368496:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007428f6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5797:x1875954704057344:12345-0@lo:503: Request processed in 220us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049883.368510:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049883.369477:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057344:0@lo:503: 00000100:00100000:1.0:1789049883.371627:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5840:1875954704057472:0@lo:502: 00000100:00100000:1.0:1789049883.371707:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049883.371822:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce165708 going to sleep for 11 seconds 00000100:00100000:3.0:1789049883.372085:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057472 00000100:00100000:3.0:1789049883.372093:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057472 00000100:00100000:3.0:1789049883.372315:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789049883.372326:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008aaafbcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5840:x1875954704057472:12345-0@lo:502: 00000100:00100000:3.0:1789049883.372628:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008aaafbcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5840:x1875954704057472:12345-0@lo:502: Request processed in 304us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049883.372638:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049883.372760:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0292c94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5840:1875954704057472:0@lo:502: 00000020:01000000:1.0:1789049883.372797:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049883.372811:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049883.372813:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789049883.372822:0:5840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789049883.372825:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049883.372852:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e36602a5) 00000020:00000080:1.0:1789049883.372873:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789049883.372891:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789049883.372990:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789049883.372999:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7878e 00000020:00000080:1.0:1789049883.373317:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789049883.373323:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049883.373329:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049883.373330:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789049883.373334:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049883.373338:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049883.373339:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789049883.373343:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049883.373350:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000cbf6bf30) 00000020:00000080:1.0:1789049883.373362:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789049883.373368:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789049883.373370:0:5840:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789049883.373373:0:5840:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789049883.373380:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789049883.373436:0:5840:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d5c378 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789049883.373452:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002ac72538) 00000020:00000080:1.0:1789049883.373476:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789049883.373535:0:5840:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789049883.373542:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b787a3 00000020:00000080:1.0:1789049883.373655:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789049883.373663:0:5840:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789049883.373668:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9df728c939b787aa 00080000:01000000:1.0:1789049883.373674:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789049883.373678:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b787b1 00080000:10000000:1.0:1789049883.374160:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789049883.374822:0:5840:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789049883.383624:0:5840:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789049883.505963:0:5840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789049883.510190:0:5840:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789049883.514877:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789049883.516455:0:5840:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789049883.578485:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000744aefaf) 00000020:00000080:3.0:1789049883.578514:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789049883.578661:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789049883.578683:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b787bf 00000020:00000080:0.0:1789049883.582320:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789049883.587253:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049883.677827:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049883.713727:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1789049883.792549:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789049883.807861:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049883.888045:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049883.966635:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789049884.016798:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9df728c939b787c6 00000020:00000080:2.0:1789049884.017158:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789049884.017169:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049884.017174:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049884.017176:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789049884.017179:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049884.017183:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049884.017185:0:5840:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789049884.017187:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049884.017189:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789049884.017191:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049884.017194:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049884.017195:0:5840:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789049884.017222:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049884.017228:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049884.017230:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789049884.017234:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789049884.017387:0:5840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789049884.017441:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac708288 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5840:1875954704057600:0@lo:502: 00000100:00100000:2.0:1789049884.017520:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049884.017616:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063101a54 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.017823:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057600 00000100:00100000:1.0:1789049884.017834:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057600 00000100:00100000:1.0:1789049884.017894:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049884.017902:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000435622ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5840:x1875954704057600:12345-0@lo:502: 00000100:00100000:1.0:1789049884.018291:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000435622ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5840:x1875954704057600:12345-0@lo:502: Request processed in 390us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.018299:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049884.018348:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac708288 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5840:1875954704057600:0@lo:502: 00000020:01000000:1.0:1789049884.018372:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049884.018377:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049884.018379:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789049884.018382:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789049884.018649:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789049884.018664:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789049884.018681:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.018691:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 000000005e7d337d/0x9df728c939b78779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049884.018704:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950707961800 from 1 10000000:01000000:2.0:1789049884.018707:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789049884.018730:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.018736:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.018744:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049884.018755:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057728:0@lo:101: 00000100:00100000:2.0:1789049884.018779:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049884.018808:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f02dc9a going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.018886:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057728 00000100:00100000:1.0:1789049884.018891:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057728 00000100:00100000:1.0:1789049884.018918:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789049884.018924:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a45719e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:5797:x1875954704057728:12345-0@lo:101: 00010000:00010000:1.0:1789049884.018933:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049884.018944:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b787cd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.018961:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b787cd expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.018969:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787cd expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.018976:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3e7f8a0, rc 0) 00000100:00100000:1.0:1789049884.019006:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a45719e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:5797:x1875954704057728:12345-0@lo:101: Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.019012:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049884.019101:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057728:0@lo:101: 00010000:00010000:2.0:1789049884.019110:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.019118:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049884.019632:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057856:0@lo:256: 00000100:00100000:2.0:1789049884.019662:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049884.019684:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f02dc9a going to sleep for 11 seconds 00000100:00100000:0.0:1789049884.019787:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057856 00000100:00100000:0.0:1789049884.019791:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057856 00000100:00100000:0.0:1789049884.019815:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049884.019821:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005313679b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:5797:x1875954704057856:12345-0@lo:256: 20000000:01000000:0.0:1789049884.019832:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789049884.019837:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789049884.019895:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005313679b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:5797:x1875954704057856:12345-0@lo:256: Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049884.019901:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049884.020049:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057856:0@lo:256: 10000000:01000000:2.0:1789049884.020674:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049884.020731:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.020750:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049884.020758:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950707961800 from 1 10000000:01000000:2.0:1789049884.020760:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049884.020780:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.020787:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.020793:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049884.020805:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057984:0@lo:101: 00000100:00100000:2.0:1789049884.020834:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049884.020865:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f02dc9a going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.020965:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704057984 00000100:00100000:1.0:1789049884.020971:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704057984 00000100:00100000:1.0:1789049884.021005:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049884.021012:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048745810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:5797:x1875954704057984:12345-0@lo:101: 00010000:00010000:1.0:1789049884.021021:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049884.021032:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b787db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.021048:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b787db expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.021056:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787db expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.021062:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2328670, rc 0) 00000100:00100000:1.0:1789049884.021101:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048745810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704057984:12345-0@lo:101: Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.021107:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049884.021243:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecad01d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704057984:0@lo:101: 00010000:00010000:3.0:1789049884.021256:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.021262:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049884.021305:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058112:0@lo:501: 00000100:00100000:3.0:1789049884.021331:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049884.021352:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000009faefeb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.021424:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058112 00000100:00100000:1.0:1789049884.021430:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058112 00000100:00100000:1.0:1789049884.021477:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049884.021487:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cd6dfc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704058112:12345-0@lo:501: 00000100:00100000:1.0:1789049884.022457:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cd6dfc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704058112:12345-0@lo:501: Request processed in 971us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.022466:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049884.022647:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058112:0@lo:501: 00000100:00100000:3.0:1789049884.022691:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058240:0@lo:503: 00000100:00100000:3.0:1789049884.022749:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049884.022855:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000009faefeb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.022896:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058240 00000100:00100000:1.0:1789049884.022902:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058240 00000100:00100000:1.0:1789049884.022997:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049884.023009:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9a0b2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704058240:12345-0@lo:503: 00000040:00080000:1.0:1789049884.023062:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049884.023109:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9a0b2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704058240:12345-0@lo:503: Request processed in 105us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.023116:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049884.023195:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058240:0@lo:503: 00000040:00080000:3.0:1789049884.024057:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789049884.024334:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789049884.024351:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049884.024364:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.024375:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049884.024417:0:5797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789049884.024420:0:5797:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff950707961800 10000000:01000000:0.0:1789049884.024423:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff950707961800 10000000:01000000:0.0:1789049884.024435:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049884.024441:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950707961800 from 1 10000000:01000000:0.0:1789049884.024443:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049884.024483:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.024491:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.024499:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049884.024513:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058368:0@lo:101: 00000100:00100000:0.0:1789049884.024566:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049884.024883:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f1fead going to sleep for 11 seconds 00000100:00100000:2.0:1789049884.024989:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058368 00000100:00100000:2.0:1789049884.024998:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058368 00000100:00100000:2.0:1789049884.025044:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049884.025055:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019ebd1af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704058368:12345-0@lo:101: 00010000:00010000:2.0:1789049884.025069:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049884.025083:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e4ce6e0/0x9df728c939b787f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b787e9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.025103:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e4ce6e0/0x9df728c939b787f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b787e9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.025113:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e4ce6e0/0x9df728c939b787f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787e9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.025360:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e4ce6e0, rc 0) 00000100:00100000:2.0:1789049884.025399:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019ebd1af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704058368:12345-0@lo:101: Request processed in 347us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049884.025406:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789049884.025523:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058368:0@lo:101: 00010000:00010000:0.0:1789049884.025543:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.025565:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049884.025629:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058496:0@lo:501: 00000100:00100000:0.0:1789049884.025670:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049884.025716:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f1fead going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.025799:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058496 00000100:00100000:1.0:1789049884.025808:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058496 00000100:00100000:1.0:1789049884.025896:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049884.025904:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084cb5e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704058496:12345-0@lo:501: 00000100:00100000:1.0:1789049884.026182:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084cb5e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704058496:12345-0@lo:501: Request processed in 279us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.026189:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049884.026286:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058496:0@lo:501: 00000100:00100000:0.0:1789049884.026314:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058624:0@lo:503: 00000100:00100000:0.0:1789049884.026351:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049884.026621:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f1fead going to sleep for 11 seconds 00000100:00100000:3.0:1789049884.026715:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058624 00000100:00100000:3.0:1789049884.026723:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058624 00000100:00100000:3.0:1789049884.026748:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049884.026762:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000958b6385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704058624:12345-0@lo:503: 00000100:00100000:3.0:1789049884.027065:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000958b6385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704058624:12345-0@lo:503: Request processed in 303us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049884.027072:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049884.027168:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704058624:0@lo:503: 00000100:00100000:0.0:1789049884.027640:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5845:1875954704058752:0@lo:502: 00000100:00100000:0.0:1789049884.027680:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049884.027708:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd67f129 going to sleep for 11 seconds 00000100:00100000:3.0:1789049884.027753:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058752 00000100:00100000:3.0:1789049884.027758:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058752 00000100:00100000:3.0:1789049884.027782:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789049884.027789:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f049c23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5845:x1875954704058752:12345-0@lo:502: 00000100:00100000:3.0:1789049884.028070:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f049c23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5845:x1875954704058752:12345-0@lo:502: Request processed in 280us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049884.028078:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789049884.028163:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5845:1875954704058752:0@lo:502: 00000020:01000004:0.0:1789049884.028309:0:5845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789049884.028325:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003c7782d9) 00000020:00000080:0.0:1789049884.028348:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789049884.028434:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d5c378 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049884.028439:0:5845:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d6d5c378 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049884.028441:0:5845:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d6d5c378 4 00010000:00080000:0.0:1789049884.028483:0:5845:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000514060f6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:0.0:1789049884.030664:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789049884.030896:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789049884.030933:0:5845:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789049884.030946:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9df728c939b787fe 00000100:00080000:0.0:1789049884.030955:0:5845:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049884.030964:0:5845:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000514060f6 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789049884.030997:0:5845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c132062 x1875954704058880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789049884.031031:0:5845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789049884.033269:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704058880:0@lo:38: 00000100:00100000:1.0:1789049884.033355:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049884.033632:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704058880 00000100:00100000:3.0:1789049884.033643:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704058880 00000100:00100000:3.0:1789049884.033681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049884.033689:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0292c94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704058880:12345-0@lo:38: 00000100:00100000:3.0:1789049884.033767:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0292c94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704058880:12345-0@lo:38: Request processed in 76us (412us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789049884.033775:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049884.033877:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789049884.033884:0:3281:0:(import.c:65:import_set_state_nolock()) 00000000514060f6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789049884.033888:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789049884.033891:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c132062 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704058880:0@lo:38: 00000100:00100000:1.0:1789049884.034447:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb302466 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5845:1875954704059008:0@lo:502: 00000100:00100000:1.0:1789049884.034497:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049884.034537:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059008 00000100:00100000:1.0:1789049884.034544:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059008 00000100:00100000:1.0:1789049884.034599:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049884.034609:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bcb0e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5845:x1875954704059008:12345-0@lo:502: 00000100:00100000:1.0:1789049884.034864:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bcb0e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5845:x1875954704059008:12345-0@lo:502: Request processed in 257us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.034871:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049884.034921:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b1fb426 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.034937:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb302466 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5845:1875954704059008:0@lo:502: 00000040:00080000:1.0:1789049884.034957:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789049884.035112:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789049884.035141:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049884.035162:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.035171:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 00000000ea70c473/0x9df728c939b787e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789049884.035244:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789049884.035246:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049884.035251:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049884.035252:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049884.035253:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049884.035254:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049884.035255:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049884.035256:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049884.035257:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049884.035258:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049884.035259:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049884.035261:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049884.035264:0:5797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789049884.035266:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049884.035267:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049884.035268:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049884.035268:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049884.035269:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049884.035270:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049884.035271:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049884.035272:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049884.035272:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049884.035273:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049884.035274:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049884.035274:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049884.035289:0:5797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049884.035297:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704059136:0@lo:253: 00000100:00100000:3.0:1789049884.035330:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049884.035344:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000005100f796 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.035494:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059136 00000100:00100000:1.0:1789049884.035500:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059136 00000100:00100000:1.0:1789049884.035534:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049884.035541:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bef0bdc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5797:x1875954704059136:12345-0@lo:253: 20000000:01000000:1.0:1789049884.035581:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789049884.035595:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789049884.083141:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789049884.083167:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789049884.083285:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789049884.083290:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789049884.083310:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.083330:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787cd expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.083338:0:5833:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.083402:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049884.083418:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 12 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049884.083432:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b8e28bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704059264:0@lo:104: 00000100:00100000:3.0:1789049884.083494:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049884.083568:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 000000009faefeb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789049884.083944:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059264 00000100:00100000:1.0:1789049884.083953:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059264 00000100:00100000:1.0:1789049884.083999:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049884.084007:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031c460b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704059264:12345-0@lo:104: 00010000:00010000:1.0:1789049884.084018:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049884.084068:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049884.084073:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031c460b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704059264:12345-0@lo:104: Request processed in 68us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049884.084080:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049884.084226:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b8e28bf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704059264:0@lo:104: 00010000:00010000:3.0:1789049884.084243:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085520:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049884.085530:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085541:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1e0f93a already unused, calling callback (00000000d1af8a30) 10000000:00010000:0.0:1789049884.085569:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085578:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049884.085585:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049884.085591:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049884.085625:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085632:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049884.085669:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085676:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: 00000000b1e0f93a/0x9df728c939b787cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787d4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.085695:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049884.085697:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049884.085699:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049884.085836:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c11e496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704059392:0@lo:103: 00000100:00100000:2.0:1789049884.085887:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049884.086034:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059392 00000100:00100000:0.0:1789049884.086040:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059392 00010000:00010000:0.0:1789049884.086064:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 13 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049884.086095:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049884.086103:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f80cac8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3283:x1875954704059392:12345-0@lo:103: 00010000:00010000:0.0:1789049884.086114:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049884.086124:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 13 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086286:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 13 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086300:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3e7f8a0/0x9df728c939b787d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b787cd expref: 13 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086312:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086320:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049884.086335:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003045199s 00010000:00010000:0.0:1789049884.086339:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086346:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086352:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086357:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086362:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c4c40de already unused, calling callback (0000000068404a19) 00010000:00010000:0.0:1789049884.086366:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086372:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086400:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049884.086410:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049884.086443:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f80cac8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3283:x1875954704059392:12345-0@lo:103: Request processed in 341us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049884.086449:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789049884.086545:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.086564:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049884.086569:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c4c40de/0x9df728c939b78805 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049884.086601:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c11e496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704059392:0@lo:103: 00000100:00100000:2.0:1789049884.090284:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bef0bdc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5797:x1875954704059136:12345-0@lo:253: Request processed in 54734us (54943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049884.090301:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049884.090409:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5797:1875954704059136:0@lo:253: 10000000:01000000:3.0:1789049884.090425:0:5797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049884.090428:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049884.090430:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049884.090431:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049884.090433:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049884.090434:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049884.090436:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049884.090437:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049884.090439:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049884.090440:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049884.090441:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049884.090442:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049884.090444:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789049884.090460:0:5797:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789049884.098704:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.099104:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049884.099865:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.100049:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049884.100503:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.100689:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049884.101650:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.101828:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049884.102044:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.102578:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049884.102813:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049884.103029:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789049884.145381:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789049884.188452:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789049884.190076:0:5851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789049884.193745:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789049884.193940:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789049884.197637:0:5850:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789049884.197649:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:0.0:1789049884.200844:0:5797:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789049884.200865:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789049884.201394:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049884.206466:0:5797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789049884.206977:0:5797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789049884.207009:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789049884.207987:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789049884.208229:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789049884.216676:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789049884.216818:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789049884.216998:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789049884.217153:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789049884.217348:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789049884.217481:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789049884.217663:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789049884.217789:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789049884.222690:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789049884.222967:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789049884.223673:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789049884.223903:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789049884.224057:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789049884.224472:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789049884.224641:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789049884.224770:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789049884.226022:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789049884.226994:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789049884.227195:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789049884.227407:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789049884.227619:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789049884.227759:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789049884.227911:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789049884.228048:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789049884.228226:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789049884.228366:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789049884.228571:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789049884.228722:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789049884.228896:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789049884.229031:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789049884.229177:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789049884.229343:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789049884.229578:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789049884.291973:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789049884.358176:0:5797:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789049884.358234:0:5797:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa435c1d8b988 00100000:10000000:1.0:1789049884.358259:0:5797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789049884.359611:0:5797:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049884.359631:0:5797:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049884.359648:0:5797:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789049884.359679:0:5797:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789049884.416595:0:5851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789049884.416684:0:5851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789049884.416689:0:5851:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789049884.811441:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049885.839529:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049886.860338:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049887.884127:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049888.920605:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049889.101846:0:6093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789049889.427551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789049889.427564:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789049889.427567:0:8:0:(import.c:65:import_set_state_nolock()) 00000000514060f6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789049889.427585:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000514060f6 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789049889.427605:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b8e28bf x1875954704059648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789049889.434402:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704059520:0@lo:400: 00000100:00100000:1.0:1789049889.434478:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049889.434581:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b8e28bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704059648:0@lo:38: 00000100:00100000:1.0:1789049889.434610:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049889.434658:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059520 00000100:00100000:1.0:1789049889.434667:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059520 00000100:00100000:1.0:1789049889.434709:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049889.434717:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f3bb8d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3284:x1875954704059520:12345-0@lo:400: 00000100:00100000:1.0:1789049889.434763:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f3bb8d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3284:x1875954704059520:12345-0@lo:400: Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049889.434769:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049889.434814:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77abff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704059520:0@lo:400: 00000100:00100000:3.0:1789049889.448046:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059648 00000100:00100000:3.0:1789049889.448066:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059648 00000100:00100000:3.0:1789049889.448113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049889.448120:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb302466 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704059648:12345-0@lo:38: 00010000:00080000:3.0:1789049889.448152:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:3.0:1789049889.448400:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9df728c939b7880c 00000004:00100000:3.0:1789049889.448442:0:5819:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789049889.448627:0:5819:0:(import.c:65:import_set_state_nolock()) 0000000012968f59 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049889.448723:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb302466 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875954704059648:12345-0@lo:38: Request processed in 602us (14112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049889.448732:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789049889.448961:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006b8e28bf x1875954704059648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789049889.448979:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789049889.448987:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789049889.448992:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789049889.448994:0:3281:0:(import.c:65:import_set_state_nolock()) 00000000514060f6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789049889.449007:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b8e28bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704059648:0@lo:38: 00010000:00010000:3.0:1789049889.932340:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049890.955300:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789049890.955310:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950707961800 from 3 10000000:01000000:1.0:1789049890.955317:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049890.955394:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049890.955408:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049890.955421:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049890.955452:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030c7984a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704059776:0@lo:101: 00010000:00010000:0.0:1789049890.955487:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049890.955556:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049890.955639:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0088eb4 going to sleep for 11 seconds 00000100:00100000:2.0:1789049890.955640:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059776 00000100:00100000:2.0:1789049890.955655:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059776 00000100:00100000:2.0:1789049890.957342:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789049890.957362:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000544b5a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5815:x1875954704059776:12345-0@lo:101: 00010000:00010000:2.0:1789049890.957381:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049890.957400:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1e0f93a/0x9df728c939b7881a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78813 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049890.957447:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1e0f93a/0x9df728c939b7881a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78813 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049890.957456:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1e0f93a/0x9df728c939b7881a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78813 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049890.957465:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1e0f93a, rc 0) 00000100:00100000:2.0:1789049890.957556:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000544b5a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704059776:12345-0@lo:101: Request processed in 204us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049890.957563:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049890.957680:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030c7984a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704059776:0@lo:101: 00010000:00010000:0.0:1789049890.957699:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049890.957707:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049890.957772:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2021297 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704059904:0@lo:256: 00000100:00100000:0.0:1789049890.957811:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049890.963117:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704059904 00000100:00100000:1.0:1789049890.963135:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704059904 00000100:00100000:0.0:1789049890.963176:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000361e0fa9 going to sleep for 11 seconds 00000100:00100000:1.0:1789049890.963304:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049890.963315:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084224e2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704059904:12345-0@lo:256: 20000000:01000000:1.0:1789049890.963338:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049890.963365:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049890.963368:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789049890.963498:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084224e2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704059904:12345-0@lo:256: Request processed in 185us (5686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049890.963537:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2021297 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704059904:0@lo:256: 10000000:01000000:0.0:1789049890.963586:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049890.963594:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049890.963604:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: 000000000bdd03ea/0x9df728c939b78813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049890.963777:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789049891.980451:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049893.008105:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049893.621062:0:6296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc61a6cd20 20000000:00000080:3.0:1789049893.621145:0:6296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95073f3b5800 uarg=0000000000000000 20000000:01000000:3.0:1789049893.621183:0:6296:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789049893.621191:0:6296:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789049893.621195:0:6296:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789049893.621620:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789049893.621634:0:6296:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789049893.627194:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049893.627770:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789049893.627829:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789049893.627874:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789049893.627892:0:6296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789049893.627907:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.628047:0:6296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787db expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.628054:0:6296:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.628103:0:6296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b787db expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.628118:0:6296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b787db expref: 11 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049893.628144:0:6296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1875954704060032:0@lo:104: 00000100:00100000:3.0:1789049893.628226:0:6296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049893.628285:0:6296:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aba596b going to sleep for 11 seconds 00000100:00100000:0.0:1789049893.628397:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060032 00000100:00100000:0.0:1789049893.628405:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060032 00000100:00100000:0.0:1789049893.628458:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049893.628466:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030deb91c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:6296:x1875954704060032:12345-0@lo:104: 00010000:00010000:0.0:1789049893.628478:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628550:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049893.628556:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030deb91c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:6296:x1875954704060032:12345-0@lo:104: Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049893.628570:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789049893.628592:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049893.628596:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628603:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a305d8d already unused, calling callback (00000000d1af8a30) 10000000:00010000:0.0:1789049893.628606:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628614:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049893.628620:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049893.628625:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049893.628662:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628669:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049893.628687:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628693:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: 000000004a305d8d/0x9df728c939b787db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.628710:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049893.628712:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049893.628713:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049893.628994:0:6296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1875954704060032:0@lo:104: 00010000:00010000:3.0:1789049893.629012:0:6296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049893.629183:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2021297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704060160:0@lo:103: 00000100:00100000:1.0:1789049893.629260:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049893.629407:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060160 00000100:00100000:0.0:1789049893.629420:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060160 00010000:00010000:0.0:1789049893.629438:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787db expref: 12 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049893.629468:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049893.629475:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9d9572c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3285:x1875954704060160:12345-0@lo:103: 00010000:00010000:0.0:1789049893.629498:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049893.629513:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787db expref: 12 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629523:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b787db expref: 12 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629536:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e2328670/0x9df728c939b787e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b787db expref: 12 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629548:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629555:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629567:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629573:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629578:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629583:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629594:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc93adc1 already unused, calling callback (0000000068404a19) 00010000:00010000:0.0:1789049893.629598:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629603:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629618:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049893.629626:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049893.630118:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9d9572c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3285:x1875954704060160:12345-0@lo:103: Request processed in 643us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049893.630127:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789049893.630323:0:6296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.630332:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049893.630338:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc93adc1/0x9df728c939b78821 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049893.631047:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2021297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704060160:0@lo:103: 00010000:00010000:0.0:1789049894.029679:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049894.541652:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6ccfe39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704060416:0@lo:400: 00000100:00100000:1.0:1789049894.541735:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049894.541805:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049894.541812:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fef095f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704060288:0@lo:400: 00000100:00100000:1.0:1789049894.541844:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049894.541885:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060416 00000100:00100000:1.0:1789049894.541893:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060416 00000100:00100000:1.0:1789049894.541941:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049894.541950:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000672f0ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704060416:12345-0@lo:400: 00000100:00100000:1.0:1789049894.542010:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000672f0ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704060416:12345-0@lo:400: Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049894.542017:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049894.542072:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a6ccfe39 x1875954704060416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049894.542088:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6ccfe39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704060416:0@lo:400: 00000100:00100000:1.0:1789049894.542142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060288 00000100:00100000:1.0:1789049894.542146:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060288 00000100:00100000:1.0:1789049894.542172:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049894.542178:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000211e97b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3283:x1875954704060288:12345-0@lo:400: 00000100:00100000:1.0:1789049894.542237:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000211e97b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3283:x1875954704060288:12345-0@lo:400: Request processed in 59us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049894.542243:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049894.542276:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fef095f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704060288:0@lo:400: 00010000:00010000:3.0:1789049895.056561:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049896.076502:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049897.103747:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049898.130409:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049899.148257:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049899.150230:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049899.150238:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950707961800 from 1 10000000:01000000:1.0:1789049899.150254:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049899.150293:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: 000000008bb6a16e/0x9df728c939b78828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049899.150307:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: 000000008bb6a16e/0x9df728c939b78828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049899.150317:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: 000000008bb6a16e/0x9df728c939b78828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049899.150339:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fef095f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060544:0@lo:101: 00000100:00100000:1.0:1789049899.150401:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049899.150445:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015e8b698 going to sleep for 11 seconds 00000100:00100000:3.0:1789049899.150949:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060544 00000100:00100000:3.0:1789049899.150965:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060544 00000100:00100000:3.0:1789049899.151038:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049899.151049:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000966f4eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:5815:x1875954704060544:12345-0@lo:101: 00010000:00010000:3.0:1789049899.151068:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049899.151087:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6374808/0x9df728c939b7882f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78828 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049899.151116:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6374808/0x9df728c939b7882f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78828 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049899.151128:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6374808/0x9df728c939b7882f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78828 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049899.151148:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6374808, rc 0) 00000100:00100000:3.0:1789049899.151262:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000966f4eec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704060544:12345-0@lo:101: Request processed in 215us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049899.151269:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049899.151333:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fef095f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060544:0@lo:101: 00010000:00010000:3.0:1789049899.151353:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: 000000008bb6a16e/0x9df728c939b78828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049899.151362:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: 000000008bb6a16e/0x9df728c939b78828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049899.151453:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060672:0@lo:501: 00000100:00100000:3.0:1789049899.151503:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049899.151536:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9f931c9 going to sleep for 11 seconds 00000100:00100000:3.0:1789049899.151553:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060672 00000100:00100000:3.0:1789049899.151558:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060672 00000100:00100000:3.0:1789049899.151593:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049899.151601:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000759ddeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704060672:12345-0@lo:501: 00000100:00100000:3.0:1789049899.151891:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000759ddeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704060672:12345-0@lo:501: Request processed in 291us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049899.151900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049899.151937:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060672:0@lo:501: 00000100:00100000:3.0:1789049899.151971:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060800:0@lo:503: 00000100:00100000:3.0:1789049899.152019:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049899.152037:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9f931c9 going to sleep for 11 seconds 00000100:00100000:3.0:1789049899.152058:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060800 00000100:00100000:3.0:1789049899.152063:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060800 00000100:00100000:3.0:1789049899.152086:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049899.152095:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cdfe9ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704060800:12345-0@lo:503: 00000100:00100000:3.0:1789049899.152365:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cdfe9ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704060800:12345-0@lo:503: Request processed in 270us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049899.152372:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049899.152415:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704060800:0@lo:503: 00000100:00100000:3.0:1789049899.158158:0:6617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6617:1875954704060928:0@lo:502: 00000100:00100000:3.0:1789049899.158280:0:6617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049899.158343:0:6617:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9f931c9 going to sleep for 11 seconds 00000100:00100000:0.0:1789049899.158389:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704060928 00000100:00100000:0.0:1789049899.158404:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704060928 00000100:00100000:0.0:1789049899.158455:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049899.158464:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c122ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6617:x1875954704060928:12345-0@lo:502: 00000100:00100000:0.0:1789049899.158783:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c122ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6617:x1875954704060928:12345-0@lo:502: Request processed in 320us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049899.158790:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049899.161449:0:6617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab4c17fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6617:1875954704060928:0@lo:502: 00000020:01000000:3.0:1789049899.161505:0:6617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049899.161516:0:6617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049899.161518:0:6617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049899.161524:0:6617:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950707961800 00000020:00000080:3.0:1789049899.161526:0:6617:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049899.161586:0:6617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6617:1875954704061056:0@lo:502: 00000100:00100000:3.0:1789049899.161649:0:6617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049899.161694:0:6617:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070356c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049899.162150:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061056 00000100:00100000:0.0:1789049899.162157:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061056 00000100:00100000:0.0:1789049899.162196:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049899.162218:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6617:x1875954704061056:12345-0@lo:502: 00000100:00100000:0.0:1789049899.162428:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6617:x1875954704061056:12345-0@lo:502: Request processed in 210us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049899.162443:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049899.162945:0:6617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6617:1875954704061056:0@lo:502: 00000020:01000000:3.0:1789049899.162971:0:6617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049899.162977:0:6617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049899.162979:0:6617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789049899.162983:0:6617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789049899.163319:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789049899.163338:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049899.163349:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049899.163361:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049899.660192:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704061184:0@lo:400: 00000100:00100000:1.0:1789049899.660302:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049899.660370:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061184 00000100:00100000:3.0:1789049899.660386:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061184 00000100:00100000:3.0:1789049899.660464:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049899.660487:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704061184:12345-0@lo:400: 00000100:00100000:3.0:1789049899.673679:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704061184:12345-0@lo:400: Request processed in 13183us (13366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049899.673696:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789049899.675151:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff950720824e00 x1875954704061184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049899.675170:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704061184:0@lo:400: 00010000:00010000:1.0:1789049900.173988:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789049900.346341:0:6668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049900.346346:0:6668:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789049900.346515:0:6668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95071009a800 00000020:01000004:3.0:1789049900.346532:0:6668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789049900.346545:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789049900.346559:0:6668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95073f3d8000) 00000020:00000080:3.0:1789049900.346575:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789049900.366693:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789049900.367641:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789049900.390722:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789049900.397896:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789049900.397931:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789049900.397989:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789049900.398013:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789049900.398491:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789049900.398502:0:6668:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789049900.398513:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b7883d 00000020:01000004:2.0:1789049900.398522:0:6668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789049900.398542:0:6668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789049900.398545:0:6668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789049900.398550:0:6668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789049900.398554:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789049900.398569:0:6668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff950702d999c0) 00000020:00000080:2.0:1789049900.398579:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789049900.402119:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049900.402356:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789049900.402363:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789049900.404089:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049900.404102:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789049900.404663:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789049900.404669:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789049900.406586:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049900.406790:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789049900.406796:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789049900.407827:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789049900.407836:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789049900.445866:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049900.446102:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789049900.446109:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789049900.449242:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789049900.449257:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789049900.451640:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049900.451656:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789049900.458104:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049900.458646:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789049900.458653:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789049900.459725:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789049900.459735:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789049900.526597:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049900.526797:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789049900.526803:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789049900.529124:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789049900.529136:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789049900.529873:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789049900.529895:0:6668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789049900.529900:0:6668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789049900.569737:0:6668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789049900.569780:0:6668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789049900.569785:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789049900.569786:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049900.569788:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049900.569788:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049900.569789:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049900.569791:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049900.569792:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049900.569793:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049900.569795:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049900.569796:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049900.569798:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049900.569801:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789049900.569804:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049900.569805:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049900.569806:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049900.569807:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049900.569807:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049900.569808:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049900.569809:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049900.569810:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049900.569811:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049900.569812:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049900.569813:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789049900.569838:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789049900.569856:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704061312:0@lo:253: 00000100:00100000:2.0:1789049900.569926:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.570051:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049900.570752:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061312 00000100:00100000:0.0:1789049900.570762:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061312 00000100:00100000:0.0:1789049900.570944:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049900.570954:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704061312:12345-0@lo:253: 20000000:01000000:0.0:1789049900.571488:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789049900.571493:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789049900.571497:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789049900.571500:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789049900.572586:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049900.572798:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789049900.572815:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789049900.572869:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789049900.572879:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789049900.572912:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789049900.572987:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789049900.573401:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789049900.573421:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.101@tcp 20000000:01000000:1.0:1789049900.573423:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789049900.573460:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789049900.573479:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789049900.573542:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789049900.573550:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.101@tcp (null) (null) 00000040:00080000:1.0:1789049900.573581:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789049900.573589:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789049900.573614:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789049900.573655:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789049900.574430:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789049900.574448:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.101@tcp 20000000:01000000:1.0:1789049900.574450:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789049900.574498:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789049900.574507:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789049900.574539:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789049900.574547:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.101@tcp (null) (null) 00000040:00080000:1.0:1789049900.574592:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789049900.574601:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789049900.574633:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789049900.575107:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789049900.575128:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789049900.575131:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789049900.575137:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789049900.575139:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789049900.575141:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789049900.575154:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789049900.575157:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789049900.575326:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049900.575329:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049900.576318:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049900.576459:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049900.576611:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789049900.576933:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789049900.576982:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789049900.577117:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789049900.577132:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789049900.577134:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789049900.577662:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789049900.577903:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789049900.577944:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789049900.578004:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789049900.578017:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789049900.578018:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049900.579141:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049900.580868:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049900.581011:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789049900.581693:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789049900.581766:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789049900.581804:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1789049900.581820:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049900.581839:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581858:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7875d expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581866:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78779 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581873:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b787e9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581880:0:5812:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581931:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.581947:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 12 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.581972:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061440:0@lo:104: 00000100:00100000:2.0:1789049900.582030:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049900.582089:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.582098:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 12 pid: 5812 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.582105:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061568:0@lo:104: 00000100:00100000:2.0:1789049900.582127:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049900.582153:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.582162:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 12 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.582170:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061696:0@lo:104: 00000100:00100000:3.0:1789049900.582330:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061440 00000100:00100000:3.0:1789049900.582337:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061440 00000100:00100000:3.0:1789049900.582382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061568 00000100:00100000:3.0:1789049900.582386:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061568 00000100:00100000:3.0:1789049900.582401:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049900.582409:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:5812:x1875954704061440:12345-0@lo:104: 00010000:00010000:3.0:1789049900.582427:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.582621:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.582679:0:5800:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789049900.582687:0:5800:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789049900.583124:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061696 00000100:00100000:0.0:1789049900.583130:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061696 00000100:00100000:1.0:1789049900.583283:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049900.583291:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5812:x1875954704061568:12345-0@lo:104: 00010000:00010000:1.0:1789049900.583302:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.583933:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049900.583958:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5812:x1875954704061440:12345-0@lo:104: Request processed in 1548us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.583966:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049900.583990:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049900.583998:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:5812:x1875954704061696:12345-0@lo:104: 00010000:00010000:3.0:1789049900.584007:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584056:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789049900.584062:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:5812:x1875954704061696:12345-0@lo:104: Request processed in 66us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.584068:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789049900.584091:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049900.584098:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584105:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049900.584110:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584117:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049900.584124:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049900.584130:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049900.584160:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584176:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049900.584195:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.584544:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c15b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.584564:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061440:0@lo:104: 00000100:00100000:2.0:1789049900.584571:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061696:0@lo:104: 00010000:00010000:3.0:1789049900.584687:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b787e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b787f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584703:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049900.584706:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584711:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049900.584714:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584721:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049900.584726:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049900.584731:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049900.584758:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584764:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049900.584790:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584797:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bd25200/0x9df728c939b7875d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78764 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.584815:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.584816:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.584818:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.584824:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049900.584837:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704061824:0@lo:103: 00000100:00100000:3.0:1789049900.584875:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049900.584907:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049900.585001:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061824 00000100:00100000:0.0:1789049900.585007:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061824 00010000:00010000:0.0:1789049900.585031:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049900.585056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049900.585064:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3285:x1875954704061824:12345-0@lo:103: 00010000:00010000:0.0:1789049900.585075:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049900.585080:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.585090:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.585104:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ec00/0x9df728c939b787f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b787e9 expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.585116:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049900.585148:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3285:x1875954704061824:12345-0@lo:103: Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049900.585154:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049900.585190:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704061824:0@lo:103: 00000100:00100000:3.0:1789049900.585328:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704061952:0@lo:103: 00000100:00100000:3.0:1789049900.585567:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049900.586336:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049900.586349:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5812:x1875954704061568:12345-0@lo:104: Request processed in 3056us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049900.586358:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049900.586367:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704061568:0@lo:104: 00010000:00010000:2.0:1789049900.586395:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586636:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049900.586643:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586650:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049900.586653:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586662:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049900.586669:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049900.586674:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049900.586718:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586725:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049900.586761:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586769:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05ec00/0x9df728c939b78779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78780 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.586785:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.586787:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.586788:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049900.586794:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049900.586804:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704062080:0@lo:103: 00000100:00100000:3.0:1789049900.586837:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.590815:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704061952 00000100:00100000:0.0:1789049900.590842:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704061952 00010000:00010000:2.0:1789049900.591082:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 12 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.591957:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062080 00000100:00100000:2.0:1789049900.591964:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062080 00010000:00010000:2.0:1789049900.591993:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 13 pid: 5812 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049900.592032:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049900.592045:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3283:x1875954704061952:12345-0@lo:103: 00010000:00010000:0.0:1789049900.592060:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049900.592066:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592087:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592173:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030400/0x9df728c939b78764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7875d expref: 13 pid: 5811 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592188:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049900.592279:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3283:x1875954704061952:12345-0@lo:103: Request processed in 238us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049900.592287:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049900.592306:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049900.592313:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3282:x1875954704062080:12345-0@lo:103: 00010000:00010000:0.0:1789049900.592322:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049900.592326:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 11 pid: 5812 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592336:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 11 pid: 5812 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592347:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030000/0x9df728c939b78780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78779 expref: 11 pid: 5812 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592358:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592366:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592380:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592392:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592397:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592403:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592409:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789049900.592413:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592420:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592435:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592445:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049900.592486:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:3282:x1875954704062080:12345-0@lo:103: Request processed in 174us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049900.592493:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049900.592533:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704062080:0@lo:103: 00010000:00010000:0.0:1789049900.592560:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592568:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.592586:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f400/0x9df728c939b7884b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049900.592605:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789049900.592611:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704061952:0@lo:103: 00000100:00100000:1.0:1789049900.653904:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:6668:x1875954704061312:12345-0@lo:253: Request processed in 82940us (83966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049900.653919:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049900.654049:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704061312:0@lo:253: 10000000:01000000:2.0:1789049900.654066:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789049900.654070:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049900.654071:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049900.654072:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049900.654074:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789049900.654075:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049900.654076:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049900.654078:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049900.654079:0:6668:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789049900.654081:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049900.654082:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789049900.654103:0:6668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95071009a800 from lustre-OST0000 10000000:01000000:2.0:1789049900.654155:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789049900.654158:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789049900.654165:0:6668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff950706403380 local copy 10000000:01000000:2.0:1789049900.654168:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789049900.654237:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.654248:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.654258:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.654511:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062208:0@lo:101: 00000100:00100000:2.0:1789049900.654555:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.654609:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049900.654699:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062208 00000100:00100000:3.0:1789049900.654706:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062208 00000100:00100000:3.0:1789049900.654790:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789049900.654799:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+9:6668:x1875954704062208:12345-0@lo:101: 00010000:00010000:3.0:1789049900.654810:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049900.654822:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd25200/0x9df728c939b78859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78852 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.654842:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd25200/0x9df728c939b78859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78852 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.654852:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd25200/0x9df728c939b78859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78852 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.654860:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25200, rc 0) 00000100:00100000:3.0:1789049900.654901:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:6668:x1875954704062208:12345-0@lo:101: Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.654913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049900.654985:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062208:0@lo:101: 00010000:00010000:2.0:1789049900.654997:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.655006:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.655111:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062336:0@lo:501: 00000100:00100000:2.0:1789049900.655136:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.655481:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049900.655616:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062336 00000100:00100000:1.0:1789049900.655621:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062336 00000100:00100000:1.0:1789049900.655647:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049900.655654:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:6668:x1875954704062336:12345-0@lo:501: 00000100:00100000:1.0:1789049900.655880:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:6668:x1875954704062336:12345-0@lo:501: Request processed in 225us (742us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049900.655888:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049900.656001:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062336:0@lo:501: 10000000:01000000:2.0:1789049900.656016:0:6668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789049900.656060:0:6668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789049900.656067:0:6668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656076:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656083:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656107:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789049900.656127:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95071009a800 10000000:01000000:2.0:1789049900.656132:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789049900.656137:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff950706403380 10000000:01000000:2.0:1789049900.656144:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789049900.656148:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff950706403380 from 1 10000000:01000000:2.0:1789049900.656150:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789049900.656172:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656179:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656188:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.656222:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062464:0@lo:101: 00000100:00100000:2.0:1789049900.656251:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.656269:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.656480:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062464 00000100:00100000:2.0:1789049900.656485:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062464 00000100:00100000:2.0:1789049900.656505:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789049900.656512:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+10:6668:x1875954704062464:12345-0@lo:101: 00010000:00010000:2.0:1789049900.656520:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049900.656531:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0ea00/0x9df728c939b78867 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78860 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656549:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0ea00/0x9df728c939b78867 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78860 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656559:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0ea00/0x9df728c939b78867 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78860 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656567:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0ea00, rc 0) 00000100:00100000:2.0:1789049900.656606:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704062464:12345-0@lo:101: Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.656612:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789049900.656643:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062464:0@lo:101: 00010000:00010000:2.0:1789049900.656655:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656664:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049900.656679:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789049900.656688:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656695:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049900.656702:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789049900.656706:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789049900.656710:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789049900.656712:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049900.656725:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656733:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656740:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.656761:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062592:0@lo:101: 00000100:00100000:2.0:1789049900.656787:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.656800:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.656813:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062592 00000100:00100000:2.0:1789049900.656818:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062592 00000100:00100000:2.0:1789049900.656835:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789049900.656841:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704062592:12345-0@lo:101: 00010000:00010000:2.0:1789049900.656848:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049900.656856:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7886e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656868:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7886e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656876:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7886e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656883:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f200, rc 0) 00000100:00100000:2.0:1789049900.656910:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704062592:12345-0@lo:101: Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.656915:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789049900.656944:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062592:0@lo:101: 00010000:00010000:2.0:1789049900.656953:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.656960:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.657120:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062720:0@lo:501: 00000100:00100000:2.0:1789049900.657144:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.657158:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.657170:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062720 00000100:00100000:2.0:1789049900.657174:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062720 00000100:00100000:2.0:1789049900.657191:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049900.657196:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704062720:12345-0@lo:501: 00000100:00100000:2.0:1789049900.657588:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704062720:12345-0@lo:501: Request processed in 390us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.657595:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049900.657625:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062720:0@lo:501: 00000100:00100000:2.0:1789049900.657651:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062848:0@lo:503: 00000100:00100000:2.0:1789049900.657686:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.657699:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.657712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062848 00000100:00100000:2.0:1789049900.657715:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062848 00000100:00100000:2.0:1789049900.657732:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049900.657738:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704062848:12345-0@lo:503: 00000100:00100000:2.0:1789049900.657876:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704062848:12345-0@lo:503: Request processed in 124us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.657882:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049900.657917:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704062848:0@lo:503: 00010000:00010000:1.0:1789049900.658156:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049900.658169:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.658177:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049900.658181:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.658190:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049900.658196:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049900.658227:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049900.658248:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.658254:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049900.658275:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.658293:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b78852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78859 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.658308:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049900.658310:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049900.658311:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049900.658681:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704062976:0@lo:103: 00000100:00100000:3.0:1789049900.658714:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789049900.658945:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049900.658997:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063104:0@lo:502: 00000100:00100000:2.0:1789049900.659032:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.659124:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704062976 00000100:00100000:1.0:1789049900.659129:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704062976 00000100:00100000:1.0:1789049900.659169:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049900.659177:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3284:x1875954704062976:12345-0@lo:103: 00010000:00010000:1.0:1789049900.659194:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049900.659234:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd25200/0x9df728c939b78859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78852 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.659249:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049900.659385:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704062976:0@lo:103: 00000100:00100000:2.0:1789049900.659526:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049900.659561:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:3284:x1875954704062976:12345-0@lo:103: Request processed in 102us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049900.659568:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049900.659627:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063104 00000100:00100000:3.0:1789049900.659632:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063104 00000100:00100000:3.0:1789049900.659659:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789049900.659665:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704063104:12345-0@lo:502: 00000100:00100000:3.0:1789049900.659828:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704063104:12345-0@lo:502: Request processed in 162us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.659834:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049900.659908:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063104:0@lo:502: 00000040:00080000:1.0:1789049900.660160:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789049900.660241:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789049900.660272:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789049900.660507:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789049900.660539:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789049900.660565:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789049900.660591:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063232:0@lo:502: 00000100:00100000:1.0:1789049900.660628:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.660648:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049900.660706:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063232 00000100:00100000:3.0:1789049900.660712:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063232 00000100:00100000:3.0:1789049900.660731:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049900.660737:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704063232:12345-0@lo:502: 00000100:00100000:3.0:1789049900.660861:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704063232:12345-0@lo:502: Request processed in 123us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.660867:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789049900.660938:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063232:0@lo:502: 00000040:00080000:1.0:1789049900.661013:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789049900.661022:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789049900.661991:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049900.662000:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789049900.662006:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.662008:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789049900.662013:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049900.662026:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95073f3dcd40) 00000020:00000080:3.0:1789049900.662115:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789049900.662123:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049900.662183:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95071009a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789049900.662367:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789049900.662443:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b78883 00010000:00010000:3.0:1789049900.666808:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789049900.667546:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789049900.670022:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789049900.670863:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789049900.678553:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789049900.679003:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789049900.680805:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789049900.680817:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049900.680824:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.680826:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789049900.680830:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049900.680834:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.680836:0:6688:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049900.680839:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049900.680841:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789049900.680892:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049900.680895:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.680896:0:6688:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049900.680899:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789049900.682153:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789049900.682187:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049900.682236:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.682249:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049900.682257:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95071009a800 from 1 10000000:01000000:0.0:1789049900.682260:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049900.682362:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.682438:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.682452:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049900.682485:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063360:0@lo:101: 00000100:00100000:0.0:1789049900.682551:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.682596:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950711913c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049900.682791:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063360 00000100:00100000:3.0:1789049900.682800:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063360 00000100:00100000:3.0:1789049900.682841:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049900.682850:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:6668:x1875954704063360:12345-0@lo:101: 00010000:00010000:3.0:1789049900.682863:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049900.682876:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7888a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.682897:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7888a expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.682923:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7888a expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.682932:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd24a00, rc 0) 00000100:00100000:3.0:1789049900.682985:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063360:12345-0@lo:101: Request processed in 135us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.682992:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789049900.683171:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063360:0@lo:101: 00010000:00010000:1.0:1789049900.683186:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.683195:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049900.685750:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063488:0@lo:501: 00000100:00100000:1.0:1789049900.685812:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.685861:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049900.685924:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063488 00000100:00100000:3.0:1789049900.685932:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063488 00000100:00100000:3.0:1789049900.685981:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049900.685991:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063488:12345-0@lo:501: 00000100:00100000:3.0:1789049900.686256:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063488:12345-0@lo:501: Request processed in 266us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.686263:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049900.686564:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063488:0@lo:501: 00000100:00100000:1.0:1789049900.686597:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063616:0@lo:503: 00000100:00100000:1.0:1789049900.686679:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.686708:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049900.686747:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063616 00000100:00100000:3.0:1789049900.686752:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063616 00000100:00100000:3.0:1789049900.686782:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049900.686788:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063616:12345-0@lo:503: 00000100:00100000:3.0:1789049900.686968:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063616:12345-0@lo:503: Request processed in 179us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.686975:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049900.687016:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063616:0@lo:503: 00000040:00080000:3.0:1789049900.689579:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049900.689664:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063744:0@lo:502: 00000100:00100000:3.0:1789049900.689734:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049900.689785:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.689902:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063744 00000100:00100000:2.0:1789049900.689909:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063744 00000100:00100000:2.0:1789049900.689954:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789049900.689962:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063744:12345-0@lo:502: 00000100:00100000:2.0:1789049900.690798:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063744:12345-0@lo:502: Request processed in 833us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.690807:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049900.690950:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063744:0@lo:502: 00000040:00080000:3.0:1789049900.692249:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789049900.692336:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789049900.692512:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063872:0@lo:502: 00000100:00100000:3.0:1789049900.692579:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049900.692615:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789049900.692712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704063872 00000100:00100000:1.0:1789049900.692720:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704063872 00000100:00100000:1.0:1789049900.692770:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789049900.692778:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063872:12345-0@lo:502: 00000100:00100000:1.0:1789049900.693141:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704063872:12345-0@lo:502: Request processed in 363us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049900.693149:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789049900.694505:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704063872:0@lo:502: 00000040:00080000:3.0:1789049900.694651:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789049900.694663:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789049900.697892:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049900.697904:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.697907:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049900.697914:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95071009a800 00000020:00000080:3.0:1789049900.697916:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049900.697935:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049900.697937:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049900.697939:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789049900.697941:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789049900.698156:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789049900.698187:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049900.698306:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.698319:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049900.698360:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789049900.698362:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95071009a800 10000000:01000000:1.0:1789049900.698365:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95071009a800 10000000:01000000:1.0:1789049900.698369:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049900.698576:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95071009a800 from 1 10000000:01000000:1.0:1789049900.698579:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049900.698611:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.698620:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049900.698630:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049900.698652:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064000:0@lo:101: 00000100:00100000:1.0:1789049900.698711:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.698754:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.698817:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064000 00000100:00100000:2.0:1789049900.698824:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064000 00000100:00100000:2.0:1789049900.698871:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049900.698880:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704064000:12345-0@lo:101: 00010000:00010000:2.0:1789049900.698892:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049900.698904:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78898 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.698924:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78898 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.698933:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78898 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.698940:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0e800, rc 0) 00000100:00100000:2.0:1789049900.698990:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064000:12345-0@lo:101: Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.698996:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789049900.699092:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064000:0@lo:101: 00010000:00010000:0.0:1789049900.699107:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.699123:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049900.699517:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064128:0@lo:501: 00000100:00100000:0.0:1789049900.699548:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.699582:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950711913c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.699627:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064128 00000100:00100000:2.0:1789049900.699639:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064128 00000100:00100000:2.0:1789049900.699673:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789049900.699681:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064128:12345-0@lo:501: 00000100:00100000:2.0:1789049900.699899:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064128:12345-0@lo:501: Request processed in 219us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.699907:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789049900.700021:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064128:0@lo:501: 00000100:00100000:0.0:1789049900.700060:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064256:0@lo:503: 00000100:00100000:0.0:1789049900.700101:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.700120:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950711913c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049900.700135:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064256 00000100:00100000:0.0:1789049900.700138:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064256 00000100:00100000:0.0:1789049900.700167:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789049900.700174:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064256:12345-0@lo:503: 00000100:00100000:0.0:1789049900.700561:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064256:12345-0@lo:503: Request processed in 387us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049900.700568:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049900.700704:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064256:0@lo:503: 00000040:00080000:1.0:1789049900.700985:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049900.701060:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064384:0@lo:502: 00000100:00100000:1.0:1789049900.701096:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049900.701165:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.701653:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064384 00000100:00100000:2.0:1789049900.701659:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064384 00000100:00100000:2.0:1789049900.701734:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789049900.701742:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064384:12345-0@lo:502: 00000100:00100000:2.0:1789049900.701932:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064384:12345-0@lo:502: Request processed in 190us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.701939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789049900.702013:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064384:0@lo:502: 00000040:00080000:0.0:1789049900.702331:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789049900.702396:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789049900.702434:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789049900.702493:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789049900.702530:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789049900.702577:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789049900.702614:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789049900.702651:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789049900.702709:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789049900.702752:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789049900.702806:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789049900.702860:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789049900.702898:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789049900.702933:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789049900.702981:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789049900.703024:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789049900.703058:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789049900.703119:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789049900.703157:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789049900.703192:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789049900.703265:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789049900.703301:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789049900.703337:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789049900.703386:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789049900.703425:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789049900.703471:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789049900.703537:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789049900.703574:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789049900.703610:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064512:0@lo:502: 00000100:00100000:0.0:1789049900.703670:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.703710:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.703770:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064512 00000100:00100000:2.0:1789049900.703778:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064512 00000100:00100000:2.0:1789049900.703840:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049900.703850:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064512:12345-0@lo:502: 00000100:00100000:2.0:1789049900.704037:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064512:12345-0@lo:502: Request processed in 189us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.704045:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789049900.704126:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064512:0@lo:502: 00000040:00080000:0.0:1789049900.704191:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789049900.704269:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789049900.704959:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789049900.704974:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95073f3d99c0) 00000020:00000080:3.0:1789049900.704995:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789049900.705071:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95071009a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049900.705075:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95071009a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049900.705078:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95071009a800 3 00010000:00080000:3.0:1789049900.705106:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950604dbd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.101@tcp at head 00010000:00010000:2.0:1789049900.707862:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789049900.708103:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789049900.708140:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789049900.708153:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9df728c939b788ad 00000100:00080000:2.0:1789049900.708163:0:6693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049900.708173:0:6693:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff950604dbd000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789049900.708235:0:6693:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720826d80 x1875954704064640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049900.708264:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789049900.708552:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704064640:0@lo:38: 00000100:00100000:3.0:1789049900.708617:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.708909:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064640 00000100:00100000:2.0:1789049900.708916:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064640 00000100:00100000:2.0:1789049900.708955:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049900.708962:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704064640:12345-0@lo:38: 00010000:00080000:2.0:1789049900.708986:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:2.0:1789049900.709012:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9df728c939b788b4 00000004:00100000:2.0:1789049900.709026:0:5819:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789049900.709056:0:5819:0:(import.c:65:import_set_state_nolock()) ffff95073d0e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049900.709108:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875954704064640:12345-0@lo:38: Request processed in 144us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.709115:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789049900.709158:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff950720826d80 x1875954704064640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049900.709167:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049900.709174:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789049900.709179:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789049900.709184:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049900.709186:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950604dbd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789049900.709191:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704064640:0@lo:38: 00000100:00100000:3.0:1789049900.709454:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704064768:0@lo:400: 00000100:00100000:3.0:1789049900.709507:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049900.709541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064768 00000100:00100000:3.0:1789049900.709545:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064768 00000100:00100000:3.0:1789049900.709573:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049900.709580:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704064768:12345-0@lo:400: 00000100:00100000:3.0:1789049900.709617:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704064768:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.709623:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789049900.709649:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9507033d8380 x1875954704064768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049900.709658:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704064768:0@lo:400: 00000040:00080000:3.0:1789049900.709867:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789049900.710051:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789049900.710079:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049900.710100:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049900.710122:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789049900.710169:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789049900.710170:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049900.710171:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049900.710172:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049900.710174:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049900.710175:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049900.710176:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049900.710177:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049900.710179:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049900.710180:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049900.710181:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049900.710184:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789049900.710186:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049900.710188:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049900.710189:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049900.710190:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049900.710191:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049900.710192:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049900.710193:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049900.710194:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049900.710195:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049900.710196:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049900.710223:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049900.710237:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789049900.710246:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064896:0@lo:253: 00000100:00100000:0.0:1789049900.710281:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049900.710311:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.710497:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704064896 00000100:00100000:2.0:1789049900.710502:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704064896 00000100:00100000:2.0:1789049900.710537:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049900.710545:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:6668:x1875954704064896:12345-0@lo:253: 20000000:01000000:2.0:1789049900.710565:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789049900.710585:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789049900.740549:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789049900.740561:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789049900.740581:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789049900.740585:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789049900.740611:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.740631:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78813 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.740640:0:5833:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.740689:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.740704:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 13 pid: 5810 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049900.740717:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704065024:0@lo:104: 00000100:00100000:2.0:1789049900.740777:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049900.740824:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d10180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049900.740850:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065024 00000100:00100000:2.0:1789049900.740857:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065024 00000100:00100000:2.0:1789049900.741750:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049900.741763:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704065024:12345-0@lo:104: 00010000:00010000:2.0:1789049900.741777:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049900.741847:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049900.741869:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704065024:12345-0@lo:104: Request processed in 109us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049900.741888:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049900.741953:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704065024:0@lo:104: 00010000:00010000:1.0:1789049900.741975:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.743860:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049900.743883:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.743895:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049900.743899:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.743909:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049900.743916:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049900.743923:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049900.743969:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.743989:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049900.744014:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.744021:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b78813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7881a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.744053:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.744056:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049900.744057:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049900.744078:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704065152:0@lo:103: 00000100:00100000:3.0:1789049900.744138:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049900.745285:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065152 00000100:00100000:3.0:1789049900.745297:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065152 00010000:00010000:3.0:1789049900.745330:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 14 pid: 5810 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049900.745440:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049900.745453:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:3282:x1875954704065152:12345-0@lo:103: 00010000:00010000:3.0:1789049900.745475:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049900.745480:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 14 pid: 5810 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745491:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 14 pid: 5810 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745505:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b7881a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78813 expref: 14 pid: 5810 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745537:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745545:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789049900.745561:0:5803:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004976093s 00010000:00010000:3.0:1789049900.745565:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745572:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745578:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745584:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745589:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789049900.745592:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745600:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745614:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745625:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049900.745690:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3282:x1875954704065152:12345-0@lo:103: Request processed in 239us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.745697:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789049900.745748:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745756:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049900.745762:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f800/0x9df728c939b788bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049900.745796:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704065152:0@lo:103: 00000100:00100000:3.0:1789049900.755669:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:6668:x1875954704064896:12345-0@lo:253: Request processed in 45113us (45375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049900.755685:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789049900.755767:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:6668:1875954704064896:0@lo:253: 10000000:01000000:0.0:1789049900.755782:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789049900.755786:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789049900.755787:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049900.755805:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049900.755807:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049900.755808:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049900.755809:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049900.755811:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049900.755812:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049900.755813:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049900.755815:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049900.755816:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789049900.755831:0:6668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789049900.763524:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049900.763726:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789049900.764020:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049900.764538:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789049900.764756:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049900.765156:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789049900.766841:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789049901.012402:0:6668:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789049901.012410:0:6668:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789049901.012441:0:6668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789049901.012510:0:6668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789049901.012525:0:6668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789049901.012555:0:6668:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789049901.206602:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049902.219864:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049903.243357:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049904.270338:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049905.296367:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049905.814747:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049905.815601:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704065536:0@lo:400: 00000100:00100000:3.0:1789049905.815671:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049905.815727:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049905.815734:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704065408:0@lo:400: 00000100:00100000:3.0:1789049905.815770:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049905.815810:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065536 00000100:00100000:3.0:1789049905.815818:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065536 00000100:00100000:3.0:1789049905.815871:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065408 00000100:00100000:3.0:1789049905.815875:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065408 00000100:00100000:3.0:1789049905.815890:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049905.815898:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704065536:12345-0@lo:400: 00000100:00100000:3.0:1789049905.815957:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704065536:12345-0@lo:400: Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049905.815965:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049905.815982:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049905.815989:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704065408:12345-0@lo:400: 00000100:00100000:3.0:1789049905.816030:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704065408:12345-0@lo:400: Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049905.816036:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789049905.816093:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736cb3b80 x1875954704065408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049905.816107:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704065408:0@lo:400: 00010000:00080000:3.0:1789049905.816117:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736cb2a00 x1875954704065536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049905.816125:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704065536:0@lo:400: 00000100:00080000:2.0:1789049905.818163:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049905.823307:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704065280:0@lo:400: 00000100:00100000:0.0:1789049905.823517:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049905.823578:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065280 00000100:00100000:0.0:1789049905.823586:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065280 00000100:00100000:0.0:1789049905.823632:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789049905.823655:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3282:x1875954704065280:12345-0@lo:400: 00000100:00100000:0.0:1789049905.823703:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3282:x1875954704065280:12345-0@lo:400: Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049905.823710:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789049905.823756:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704065280:0@lo:400: 00010000:00010000:1.0:1789049906.330227:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049907.342374:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789049907.812777:0:7038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789049908.364461:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789049908.364470:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950707961800 from 21 10000000:01000000:1.0:1789049908.364476:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049908.364519:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.364531:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.364542:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.364565:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065664:0@lo:101: 00000100:00100000:1.0:1789049908.364626:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.364676:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd46c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789049908.364799:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049908.365571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065664 00000100:00100000:3.0:1789049908.365581:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065664 00000100:00100000:3.0:1789049908.365641:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789049908.365650:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704065664:12345-0@lo:101: 00010000:00010000:3.0:1789049908.365664:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049908.365676:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b788c2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049908.365700:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b788c2 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049908.365710:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788c2 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049908.365735:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25200, rc 0) 00000100:00100000:3.0:1789049908.365795:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704065664:12345-0@lo:101: Request processed in 145us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049908.365801:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789049908.365882:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065664:0@lo:101: 00010000:00010000:1.0:1789049908.365896:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.365905:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.365965:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065792:0@lo:501: 00000100:00100000:1.0:1789049908.366006:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.366039:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049908.366131:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065792 00000100:00100000:2.0:1789049908.366136:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065792 00000100:00100000:2.0:1789049908.366170:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789049908.366177:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704065792:12345-0@lo:501: 00000100:00100000:2.0:1789049908.366590:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704065792:12345-0@lo:501: Request processed in 413us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049908.366598:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049908.366746:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065792:0@lo:501: 00000100:00100000:1.0:1789049908.366773:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065920:0@lo:503: 00000100:00100000:1.0:1789049908.366815:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.366838:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.366851:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704065920 00000100:00100000:1.0:1789049908.366854:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704065920 00000100:00100000:1.0:1789049908.366873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049908.366880:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704065920:12345-0@lo:503: 00000100:00100000:1.0:1789049908.367178:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704065920:12345-0@lo:503: Request processed in 297us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.367185:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049908.367245:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704065920:0@lo:503: 00000100:00100000:1.0:1789049908.367473:0:7065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7065:1875954704066048:0@lo:502: 00000100:00100000:1.0:1789049908.367508:0:7065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.367527:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066048 00000100:00100000:1.0:1789049908.367531:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066048 00000100:00100000:1.0:1789049908.367548:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789049908.367554:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7065:x1875954704066048:12345-0@lo:502: 00000100:00100000:1.0:1789049908.367726:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7065:x1875954704066048:12345-0@lo:502: Request processed in 171us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.367733:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789049908.367765:0:7065:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.367776:0:7065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7065:1875954704066048:0@lo:502: 00000100:00100000:1.0:1789049908.367815:0:7065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7065:1875954704066176:0@lo:502: 00000100:00100000:1.0:1789049908.367847:0:7065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.367865:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066176 00000100:00100000:1.0:1789049908.367869:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066176 00000100:00100000:1.0:1789049908.367885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049908.367890:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7065:x1875954704066176:12345-0@lo:502: 00000100:00100000:1.0:1789049908.367999:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7065:x1875954704066176:12345-0@lo:502: Request processed in 108us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.368005:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049908.368031:0:7065:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.368042:0:7065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7065:1875954704066176:0@lo:502: 00000040:00080000:1.0:1789049908.368059:0:7065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789049908.368111:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789049908.368125:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789049908.368133:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368144:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049908.368153:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789049908.368156:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950707961800 from 4 10000000:01000000:1.0:1789049908.368159:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049908.368181:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368222:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368232:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.368244:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066304:0@lo:101: 00000100:00100000:1.0:1789049908.368269:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.368283:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.368294:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066304 00000100:00100000:1.0:1789049908.368298:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066304 00000100:00100000:1.0:1789049908.368315:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789049908.368320:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704066304:12345-0@lo:101: 00010000:00010000:1.0:1789049908.368328:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049908.368339:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b788d0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368358:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368366:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368374:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789049908.368401:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704066304:12345-0@lo:101: Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.368407:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789049908.368450:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066304:0@lo:101: 00010000:00010000:1.0:1789049908.368469:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368477:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.368519:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066432:0@lo:256: 00000100:00100000:1.0:1789049908.368548:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.368562:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.368573:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066432 00000100:00100000:1.0:1789049908.368576:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066432 00000100:00100000:1.0:1789049908.368592:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049908.368597:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704066432:12345-0@lo:256: 20000000:01000000:1.0:1789049908.368609:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049908.368625:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049908.368629:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789049908.368701:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704066432:12345-0@lo:256: Request processed in 103us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.368707:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049908.368732:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066432:0@lo:256: 10000000:01000000:1.0:1789049908.368767:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789049908.368773:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368780:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049908.368788:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789049908.368794:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789049908.368796:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789049908.368810:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368817:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368825:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.368836:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066560:0@lo:101: 00000100:00100000:1.0:1789049908.368861:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.368874:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.368884:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066560 00000100:00100000:1.0:1789049908.368887:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066560 00000100:00100000:1.0:1789049908.368903:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049908.368909:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704066560:12345-0@lo:101: 00010000:00010000:1.0:1789049908.368916:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049908.368924:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b788de expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b788de expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368946:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788de expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.368952:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:1.0:1789049908.368978:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704066560:12345-0@lo:101: Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.368990:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049908.369019:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066560:0@lo:101: 00010000:00010000:1.0:1789049908.369029:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.369036:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.369070:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066688:0@lo:501: 00000100:00100000:1.0:1789049908.369091:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.369102:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.369111:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066688 00000100:00100000:1.0:1789049908.369114:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066688 00000100:00100000:1.0:1789049908.369128:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049908.369133:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704066688:12345-0@lo:501: 00000100:00100000:1.0:1789049908.369364:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704066688:12345-0@lo:501: Request processed in 230us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.369371:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049908.369398:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066688:0@lo:501: 00000100:00100000:1.0:1789049908.369436:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066816:0@lo:503: 00000100:00100000:1.0:1789049908.369474:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.369486:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.369496:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066816 00000100:00100000:1.0:1789049908.369499:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066816 00000100:00100000:1.0:1789049908.369514:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049908.369520:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704066816:12345-0@lo:503: 00000100:00100000:1.0:1789049908.376271:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704066816:12345-0@lo:503: Request processed in 6740us (6786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.376286:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789049908.377119:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704066816:0@lo:503: 00000100:00100000:3.0:1789049908.381546:0:7066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7066:1875954704066944:0@lo:502: 00000100:00100000:3.0:1789049908.381631:0:7066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049908.381680:0:7066:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.381729:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704066944 00000100:00100000:1.0:1789049908.381736:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704066944 00000100:00100000:1.0:1789049908.381785:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789049908.381794:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7066:x1875954704066944:12345-0@lo:502: 00000100:00100000:1.0:1789049908.382301:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7066:x1875954704066944:12345-0@lo:502: Request processed in 508us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.382310:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789049908.385368:0:7066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7066:1875954704066944:0@lo:502: 00000020:01000000:3.0:1789049908.394804:0:7066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049908.394818:0:7066:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789049908.394828:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049908.394830:0:7066:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789049908.394836:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789049908.394842:0:7066:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:3.0:1789049908.394868:0:7066:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789049908.394871:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049908.394907:0:7066:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95070345b380) 00000020:00000080:3.0:1789049908.395181:0:7066:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789049908.395191:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789049908.395888:0:7066:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789049908.395896:0:7066:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789049908.395903:0:7066:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b788f3 00010000:00080000:3.0:1789049908.395933:0:7066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95060469a000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789049908.396498:0:7066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789049908.505863:0:7066:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789049908.505888:0:7066:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789049908.506463:0:7066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049908.506636:0:7066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049908.506686:0:7066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789049908.506746:0:7066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789049908.509891:0:7073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049908.509909:0:7073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789049908.512390:0:7066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789049908.512404:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789049908.512451:0:7066:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789049908.512472:0:7066:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b788fa 00000100:00080000:2.0:1789049908.512482:0:7066:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049908.512493:0:7066:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95060469a000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789049908.512527:0:7066:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720825f80 x1875954704067072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049908.512553:0:7066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789049908.512611:0:7066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049908.512615:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049908.512617:0:7066:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789049908.512627:0:7066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049908.512631:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049908.512632:0:7066:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789049908.512635:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049908.512637:0:7066:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789049908.512662:0:7066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7066:1875954704067200:0@lo:502: 00000100:00100000:0.0:1789049908.512835:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704067072:0@lo:8: 00000100:00100000:1.0:1789049908.512977:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704067328:0@lo:400: 00000100:00100000:0.0:1789049908.513074:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.513592:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.513625:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049908.513632:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704067456:0@lo:400: 00000100:00100000:1.0:1789049908.513659:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049908.513735:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067328 00000100:00100000:0.0:1789049908.513742:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067328 00000100:00100000:0.0:1789049908.513789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067456 00000100:00100000:0.0:1789049908.513792:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067456 00000100:00100000:0.0:1789049908.513820:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049908.513828:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704067328:12345-0@lo:400: 00000100:00100000:0.0:1789049908.513887:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704067328:12345-0@lo:400: Request processed in 59us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049908.513895:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049908.513913:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049908.513919:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704067456:12345-0@lo:400: 00000100:00100000:0.0:1789049908.513947:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704067456:12345-0@lo:400: Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049908.513953:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789049908.513988:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736cb3480 x1875954704067456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049908.514263:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067072 00000100:00100000:3.0:1789049908.514269:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067072 00000100:00100000:3.0:1789049908.514293:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049908.514299:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875954704067072:12345-0@lo:8: 00010000:00080000:3.0:1789049908.514322:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1789049908.514349:0:6670:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b78901 00002000:00100000:3.0:1789049908.514389:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95060469f000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789049908.514393:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789049908.514397:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789049908.514530:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789049908.514698:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789049908.514788:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704067456:0@lo:400: 00010000:00080000:0.0:1789049908.514811:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736cb1180 x1875954704067328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049908.514821:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704067328:0@lo:400: 00000100:00080000:3.0:1789049908.514909:0:6670:0:(import.c:65:import_set_state_nolock()) ffff95060469c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049908.515058:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704067072:12345-0@lo:8: Request processed in 757us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049908.515224:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789049908.515240:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720825f80 x1875954704067072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049908.515251:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049908.515258:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789049908.515265:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789049908.515270:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789049908.515273:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95060469a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789049908.515292:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789049908.515297:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704067072:0@lo:8: 00000004:00080000:1.0:1789049908.515356:0:7073:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789049908.515506:0:7073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 144503305170ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789049908.516480:0:7066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789049908.516976:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049908.517077:0:7066:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ea1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049908.518078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067200 00000100:00100000:1.0:1789049908.518091:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067200 00000100:00100000:1.0:1789049908.518145:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789049908.518155:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7066:x1875954704067200:12345-0@lo:502: 00000100:00100000:1.0:1789049908.518448:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7066:x1875954704067200:12345-0@lo:502: Request processed in 294us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049908.518457:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789049908.518578:0:7066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7066:1875954704067200:0@lo:502: 00000020:01000000:2.0:1789049908.518610:0:7066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049908.518617:0:7066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049908.518619:0:7066:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789049908.518624:0:7066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789049908.520693:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789049908.520808:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789049908.520819:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.520839:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049908.520850:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789049908.520852:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff950706403380 from 1 10000000:01000000:1.0:1789049908.520855:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789049908.520889:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.520898:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049908.520908:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049908.520928:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704067584:0@lo:101: 00000100:00100000:1.0:1789049908.520987:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049908.521850:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049908.522362:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067584 00000100:00100000:0.0:1789049908.522372:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067584 00000100:00100000:0.0:1789049908.522446:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789049908.522454:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704067584:12345-0@lo:101: 00010000:00010000:0.0:1789049908.522468:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049908.522484:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78908 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049908.522510:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049908.522521:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049908.522529:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700030200, rc 0) 00000100:00100000:0.0:1789049908.522582:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704067584:12345-0@lo:101: Request processed in 129us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049908.522588:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789049908.523363:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704067584:0@lo:101: 00010000:00010000:0.0:1789049908.523382:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049908.523393:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049908.523473:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704067712:0@lo:501: 00000100:00100000:0.0:1789049908.523512:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049908.523534:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060633e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049908.523552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067712 00000100:00100000:0.0:1789049908.523556:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067712 00000100:00100000:0.0:1789049908.523581:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789049908.523598:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704067712:12345-0@lo:501: 00000100:00100000:0.0:1789049908.525642:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704067712:12345-0@lo:501: Request processed in 2036us (2120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049908.525655:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789049908.526275:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704067712:0@lo:501: 10000000:01000000:3.0:1789049908.526314:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789049908.526323:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049908.526333:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049908.569322:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789049908.582710:0:7074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789049908.582753:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704067968:0@lo:7: 00000100:00100000:2.0:1789049908.582828:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049908.582883:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ea1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789049908.582906:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704067840:0@lo:13: 00000100:00100000:2.0:1789049908.582932:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049908.582963:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067840 00000100:00100000:3.0:1789049908.582972:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067840 00000100:00100000:2.0:1789049908.582998:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704067968 00000100:00100000:2.0:1789049908.583002:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704067968 00000100:00100000:3.0:1789049908.583020:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049908.583023:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049908.583030:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7074:x1875954704067968:12345-0@lo:7: 00000100:00100000:3.0:1789049908.583031:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704067840:12345-0@lo:13: 00002000:00000024:3.0:1789049908.583058:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789049908.583103:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704067840:12345-0@lo:13: Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049908.583110:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789049908.583130:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049908.583555:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720824a80 x1875954704067840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049908.583574:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704067840:0@lo:13: 00002000:00080000:2.0:1789049908.599004:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789049908.599017:0:6672:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789049908.599183:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7074:x1875954704067968:12345-0@lo:7: Request processed in 16148us (16351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049908.599194:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789049908.601092:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720824700 x1875954704067968/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049924 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049908.601110:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704067968:0@lo:7: 00000004:00080000:0.0:1789049908.601125:0:7074:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789049908.601376:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068096:0@lo:5: 00000100:00100000:2.0:1789049908.601443:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049908.601494:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ea1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049908.601605:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068096 00000100:00100000:0.0:1789049908.601613:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068096 00000100:00100000:0.0:1789049908.601662:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049908.601671:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7074:x1875954704068096:12345-0@lo:5: 00002000:00080000:0.0:1789049908.601697:0:6671:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789049908.601701:0:6671:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789049908.603068:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7074:x1875954704068096:12345-0@lo:5: Request processed in 1319us (1546us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789049908.603077:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789049908.603236:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720827b80 x1875954704068096/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049924 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049908.603252:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068096:0@lo:5: 00000004:00080000:2.0:1789049908.603265:0:7074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789049908.603302:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068224:0@lo:700: 00000100:00100000:2.0:1789049908.603357:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049908.603394:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ea1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049908.603464:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068224 00000100:00100000:0.0:1789049908.603471:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068224 00000100:00100000:0.0:1789049908.603504:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049908.603511:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7074:x1875954704068224:12345-0@lo:700: 00000100:00100000:0.0:1789049908.603539:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1875954704068352:0@lo:700: 00000100:00100000:0.0:1789049908.603564:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049908.603587:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060633ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049908.603604:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068352 00000100:00100000:3.0:1789049908.603608:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068352 00000100:00100000:3.0:1789049908.603646:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049908.603652:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1875954704068352:12345-0@lo:700: 40000000:02000000:3.0:1789049908.683606:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789049908.692907:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1875954704068352:12345-0@lo:700: Request processed in 89243us (89328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049908.692923:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049908.694171:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9507033d8a80 x1875954704068352/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049924 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049908.694188:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1875954704068352:0@lo:700: 40000000:02000000:1.0:1789049908.696108:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1789049908.811704:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789049908.811736:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789049908.814384:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7074:x1875954704068224:12345-0@lo:700: Request processed in 210861us (211014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049908.814398:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049908.817362:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720824700 x1875954704068224/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049924 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049908.817377:0:7074:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789049908.817393:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068224:0@lo:700: 00000004:02000040:2.0:1789049908.870907:0:7074:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789049908.874311:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068480:0@lo:5: 00000100:00100000:2.0:1789049908.874613:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049908.874692:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049908.874741:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068480 00000100:00100000:0.0:1789049908.874749:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068480 00000100:00100000:0.0:1789049908.874825:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049908.874834:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7074:x1875954704068480:12345-0@lo:5: 00002000:00080000:1.0:1789049908.890310:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789049908.890335:0:6672:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789049908.894080:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7074:x1875954704068480:12345-0@lo:5: Request processed in 19236us (19456us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1789049908.894117:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720825f80 x1875954704068480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049924 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049908.894135:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1875954704068480:0@lo:5: 00000004:00080000:2.0:1789049908.894152:0:7074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:1.0:1789049908.894306:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789049909.388865:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049910.413655:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049911.435551:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049912.464712:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789049912.963638:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789049913.490981:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049913.996498:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704068608:0@lo:13: 00000100:00100000:3.0:1789049913.996574:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049913.996638:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068608 00000100:00100000:3.0:1789049913.996646:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068608 00000100:00100000:3.0:1789049913.996705:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049913.996715:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704068608:12345-0@lo:13: 00002000:00000024:3.0:1789049913.996757:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049913.996798:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704068608:12345-0@lo:13: Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049913.996804:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789049913.996824:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049913.996852:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720826d80 x1875954704068608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049913.996862:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789049913.996881:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704068608:0@lo:13: 00000100:00100000:3.0:1789049914.000888:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704068864:0@lo:400: 00000100:00100000:0.0:1789049914.000888:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704068736:0@lo:400: 00000100:00100000:1.0:1789049914.002289:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049914.002312:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704068992:0@lo:400: 00000100:00100000:3.0:1789049914.002450:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049914.002501:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068864 00000100:00100000:3.0:1789049914.002508:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068864 00000100:00100000:3.0:1789049914.002682:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049914.002701:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704068864:12345-0@lo:400: 00000100:00100000:3.0:1789049914.002886:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704068864:12345-0@lo:400: Request processed in 186us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049914.002894:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789049914.004246:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736c97480 x1875954704068864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049914.004264:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704068864:0@lo:400: 00000100:00100000:0.0:1789049914.005605:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049914.005660:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068736 00000100:00100000:0.0:1789049914.005669:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068736 00000100:00100000:0.0:1789049914.005707:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049914.005716:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704068736:12345-0@lo:400: 00000100:00100000:0.0:1789049914.005769:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704068736:12345-0@lo:400: Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049914.005883:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049914.005932:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704068736:0@lo:400: 00000100:00100000:1.0:1789049914.013254:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049914.013325:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704068992 00000100:00100000:1.0:1789049914.013334:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704068992 00000100:00100000:1.0:1789049914.013405:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049914.013416:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704068992:12345-0@lo:400: 00000100:00100000:1.0:1789049914.013466:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704068992:12345-0@lo:400: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049914.013474:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789049914.013509:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049914.013537:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736c97100 x1875954704068992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049914.013550:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704068992:0@lo:400: 00010000:00010000:0.0:1789049914.508644:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049915.544336:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049916.555401:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049917.579428:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049918.604721:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049919.115827:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704069120:0@lo:13: 00000100:00100000:2.0:1789049919.115889:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.115895:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704069248:0@lo:400: 00000100:00100000:3.0:1789049919.115926:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.115951:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049919.115957:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704069376:0@lo:400: 00000100:00100000:2.0:1789049919.115979:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704069632:0@lo:400: 00000100:00100000:3.0:1789049919.115995:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.115999:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.116014:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049919.116019:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704069504:0@lo:400: 00000100:00100000:3.0:1789049919.116025:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069120 00000100:00100000:3.0:1789049919.116033:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069120 00000100:00100000:2.0:1789049919.116046:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.116073:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069632 00000100:00100000:2.0:1789049919.116077:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069632 00000100:00100000:3.0:1789049919.116082:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049919.116090:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704069120:12345-0@lo:13: 00000100:00100000:2.0:1789049919.116101:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049919.116106:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704069632:12345-0@lo:400: 00002000:00000024:3.0:1789049919.116119:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049919.116145:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704069120:12345-0@lo:13: Request processed in 56us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.116145:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704069632:12345-0@lo:400: Request processed in 38us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.116152:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049919.116172:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069376 00000100:00100000:2.0:1789049919.116175:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069376 00000100:00100000:2.0:1789049919.116213:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069504 00000100:00100000:2.0:1789049919.116216:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069504 00000100:00100000:2.0:1789049919.116234:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049919.116239:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704069376:12345-0@lo:400: 00000100:00100000:3.0:1789049919.116247:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049919.116265:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069248 00000100:00100000:3.0:1789049919.116269:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069248 00000100:00100000:2.0:1789049919.116273:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704069376:12345-0@lo:400: Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.116279:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049919.116291:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789049919.116291:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049919.116297:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704069248:12345-0@lo:400: 00000100:00100000:2.0:1789049919.116297:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704069504:12345-0@lo:400: 00000100:00100000:3.0:1789049919.116322:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704069248:12345-0@lo:400: Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.116322:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704069504:12345-0@lo:400: Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.116329:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789049919.116329:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789049919.116441:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049919.116445:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049919.116473:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736c94a80 x1875954704069376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789049919.116474:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736c94700 x1875954704069504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049919.116487:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704069376:0@lo:400: 00000100:00100000:2.0:1789049919.116487:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704069504:0@lo:400: 00000100:00100000:3.0:1789049919.116496:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704069248:0@lo:400: 00010000:00080000:2.0:1789049919.116497:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950736c97100 x1875954704069632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049919.116517:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704069632:0@lo:400: 00010000:00080000:2.0:1789049919.116528:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720824000 x1875954704069120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049919.116541:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704069120:0@lo:13: 00000020:01000004:2.0:1789049919.434177:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789049919.434181:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789049919.434334:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95073d0e4000 00000020:01000004:2.0:1789049919.434348:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789049919.434370:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789049919.434384:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff950702d9b380) 00000020:00000080:2.0:1789049919.434398:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789049919.447717:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789049919.448048:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789049919.467515:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789049919.473562:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789049919.473616:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789049919.473677:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789049919.473704:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789049919.475609:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789049919.475623:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789049919.475635:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b7891d 00000020:01000004:1.0:1789049919.475644:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789049919.475665:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789049919.475668:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789049919.475673:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789049919.475697:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789049919.475701:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789049919.495675:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789049919.495777:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.101@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789049919.495782:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789049919.495783:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049919.495785:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049919.495786:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049919.495787:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049919.495788:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049919.495790:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049919.495791:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049919.495792:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049919.495794:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049919.495795:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049919.495799:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789049919.495801:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789049919.495802:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049919.495803:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049919.495804:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049919.495805:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049919.495806:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049919.495807:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049919.495808:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049919.495814:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049919.495815:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049919.495816:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049919.495840:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789049919.495858:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704069760:0@lo:253: 00000100:00100000:1.0:1789049919.495921:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.496124:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049919.496444:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069760 00000100:00100000:0.0:1789049919.496452:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069760 00000100:00100000:2.0:1789049919.496594:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789049919.496603:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:7619:x1875954704069760:12345-0@lo:253: 20000000:01000000:2.0:1789049919.496638:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789049919.496642:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789049919.496646:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789049919.496649:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789049919.497845:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049919.498035:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789049919.498048:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789049919.498080:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789049919.498086:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789049919.498109:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789049919.498146:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789049919.498787:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789049919.498804:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.101@tcp 20000000:01000000:2.0:1789049919.498806:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.101@tcp (null) (null) (null) 00000040:00080000:2.0:1789049919.498843:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789049919.498850:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789049919.498897:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789049919.498905:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.101@tcp (null) (null) 00000040:00080000:2.0:1789049919.499000:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789049919.499009:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789049919.499036:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789049919.499086:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789049919.500538:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789049919.500560:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.101@tcp 20000000:01000000:2.0:1789049919.500563:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.101@tcp (null) (null) (null) 00000040:00080000:2.0:1789049919.500594:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789049919.500601:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789049919.500626:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789049919.500633:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.101@tcp (null) (null) 00000040:00080000:2.0:1789049919.500659:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789049919.500667:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789049919.500732:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789049919.500770:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789049919.500785:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789049919.500788:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789049919.500791:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789049919.500801:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789049919.500804:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789049919.500832:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789049919.500835:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789049919.501435:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789049919.501499:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789049919.501555:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789049919.501807:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789049919.501843:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789049919.501893:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789049919.501906:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789049919.501908:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789049919.502322:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789049919.502600:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789049919.502639:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789049919.502695:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789049919.502709:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789049919.502711:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789049919.503705:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789049919.503775:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789049919.503806:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789049919.504055:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789049919.504095:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789049919.504157:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789049919.504172:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789049919.504175:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789049919.504818:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789049919.504860:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789049919.504908:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789049919.505177:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789049919.505264:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789049919.505423:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789049919.505446:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789049919.505448:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789049919.505456:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789049919.505473:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505489:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7886e expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505497:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78898 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505503:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788c2 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505510:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788de expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505517:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505524:0:5812:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505558:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505572:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.505585:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704069888:0@lo:104: 00000100:00100000:0.0:1789049919.505643:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049919.505704:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b788de expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505714:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b788de expref: 16 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.505722:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070016:0@lo:104: 00010000:00010000:0.0:1789049919.505746:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505755:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 16 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.505763:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070144:0@lo:104: 00010000:00010000:0.0:1789049919.505785:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505794:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 16 pid: 5812 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.505802:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070272:0@lo:104: 00010000:00010000:0.0:1789049919.505823:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.505831:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 16 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.505839:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070400:0@lo:104: 00000100:00100000:0.0:1789049919.505854:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507064493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.505967:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049919.505986:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.506012:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.506068:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.507239:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.507589:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704069888 00000100:00100000:1.0:1789049919.507598:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704069888 00000100:00100000:1.0:1789049919.507632:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070016 00000100:00100000:1.0:1789049919.507635:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070016 00000100:00100000:1.0:1789049919.507645:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070144 00000100:00100000:1.0:1789049919.507647:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070144 00000100:00100000:1.0:1789049919.507655:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070272 00000100:00100000:1.0:1789049919.507658:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070272 00000100:00100000:1.0:1789049919.507670:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049919.507677:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5812:x1875954704069888:12345-0@lo:104: 00010000:00010000:1.0:1789049919.507692:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.507800:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049919.507806:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:5812:x1875954704069888:12345-0@lo:104: Request processed in 130us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.507814:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049919.507885:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049919.507892:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5812:x1875954704070016:12345-0@lo:104: 00010000:00010000:1.0:1789049919.507899:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508014:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789049919.508020:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:5812:x1875954704070016:12345-0@lo:104: Request processed in 129us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.508026:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049919.508039:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049919.508045:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:5812:x1875954704070144:12345-0@lo:104: 00010000:00010000:1.0:1789049919.508053:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508082:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789049919.508087:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:5812:x1875954704070144:12345-0@lo:104: Request processed in 43us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.508092:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049919.508102:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049919.508108:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5812:x1875954704070272:12345-0@lo:104: 00010000:00010000:1.0:1789049919.508114:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508140:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789049919.508145:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5812:x1875954704070272:12345-0@lo:104: Request processed in 38us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.508150:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789049919.508166:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789049919.508172:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508178:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049919.508189:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508216:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049919.508224:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049919.508229:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049919.508261:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508268:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049919.508353:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508370:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05f600/0x9df728c939b78908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7890f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508383:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789049919.508386:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508392:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049919.508394:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508401:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049919.508418:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049919.508423:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049919.508438:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508444:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049919.508450:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508456:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e200/0x9df728c939b788de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508465:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049919.508468:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508473:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049919.508476:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508482:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049919.508489:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049919.508494:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049919.508511:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508517:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049919.508531:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508538:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b788c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508546:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049919.508549:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508554:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049919.508557:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508564:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049919.508570:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049919.508575:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049919.508584:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508590:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049919.508594:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508610:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78898 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7889f expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.508618:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049919.508620:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049919.508621:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049919.508628:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049919.508647:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704070528:0@lo:103: 00000100:00100000:1.0:1789049919.508682:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.508714:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049919.508720:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704070656:0@lo:103: 00000100:00100000:1.0:1789049919.508741:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.508767:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704070784:0@lo:103: 00000100:00100000:1.0:1789049919.508790:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.508808:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049919.508813:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704070912:0@lo:103: 00000100:00100000:1.0:1789049919.508832:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.508858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070528 00000100:00100000:1.0:1789049919.508863:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070528 00010000:00010000:1.0:1789049919.508884:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 17 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.508900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070656 00000100:00100000:1.0:1789049919.508903:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070656 00010000:00010000:1.0:1789049919.508914:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788de expref: 18 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.508924:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070784 00000100:00100000:3.0:1789049919.509094:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070400 00000100:00100000:3.0:1789049919.509099:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070400 00000100:00100000:3.0:1789049919.509125:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049919.509133:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5812:x1875954704070400:12345-0@lo:104: 00010000:00010000:3.0:1789049919.509141:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509180:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049919.509185:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5812:x1875954704070400:12345-0@lo:104: Request processed in 54us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.509190:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789049919.509226:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049919.509230:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509237:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0e400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049919.509240:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509247:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049919.509253:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049919.509258:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049919.509278:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509351:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049919.509380:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509388:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7886e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78875 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.509402:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049919.509404:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049919.509405:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049919.509411:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049919.509421:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704071040:0@lo:103: 00000100:00100000:3.0:1789049919.509446:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.509552:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070784 00010000:00010000:1.0:1789049919.509584:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 19 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.509597:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704070912 00000100:00100000:1.0:1789049919.509600:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704070912 00010000:00010000:1.0:1789049919.509609:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 20 pid: 5812 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.509617:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071040 00000100:00100000:1.0:1789049919.509619:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071040 00010000:00010000:1.0:1789049919.509628:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 21 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.509638:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049919.509645:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3282:x1875954704070528:12345-0@lo:103: 00010000:00010000:1.0:1789049919.509656:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049919.509662:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 21 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509672:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 21 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509687:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049919.509759:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3282:x1875954704070528:12345-0@lo:103: Request processed in 114us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.509765:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049919.509780:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049919.509785:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+20:3282:x1875954704070656:12345-0@lo:103: 00010000:00010000:1.0:1789049919.509793:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049919.509802:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788de expref: 20 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509810:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b788de expref: 20 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509819:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049919.509841:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+20:3282:x1875954704070656:12345-0@lo:103: Request processed in 56us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.509847:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049919.509859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049919.509866:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704070784:12345-0@lo:103: 00010000:00010000:1.0:1789049919.509873:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049919.509878:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 19 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509885:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 19 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509893:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049919.509926:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704070784:12345-0@lo:103: Request processed in 60us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.509940:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049919.509953:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049919.509960:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3284:x1875954704070912:12345-0@lo:103: 00010000:00010000:1.0:1789049919.509967:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049919.509971:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 18 pid: 5812 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509989:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 18 pid: 5812 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.509998:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049919.510020:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3284:x1875954704070912:12345-0@lo:103: Request processed in 61us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.510026:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049919.510038:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789049919.510044:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3283:x1875954704071040:12345-0@lo:103: 00010000:00010000:1.0:1789049919.510051:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049919.510055:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 17 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510063:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 17 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510073:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510081:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510094:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510102:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510108:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510120:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510125:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789049919.510128:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510134:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510142:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.510151:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049919.510181:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3283:x1875954704071040:12345-0@lo:103: Request processed in 137us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049919.510188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789049919.510246:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704071040:0@lo:103: 00010000:00010000:0.0:1789049919.510463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030200/0x9df728c939b7890f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78908 expref: 16 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.510483:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704069888:0@lo:104: 00010000:00010000:0.0:1789049919.510496:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05ec00/0x9df728c939b788e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b788de expref: 15 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.510503:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070016:0@lo:104: 00010000:00010000:0.0:1789049919.510516:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd25200/0x9df728c939b788c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b788c2 expref: 14 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.510524:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070144:0@lo:104: 00010000:00010000:0.0:1789049919.510531:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0e800/0x9df728c939b7889f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78898 expref: 13 pid: 5812 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.510538:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070272:0@lo:104: 00010000:00010000:0.0:1789049919.510546:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f200/0x9df728c939b78875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7886e expref: 12 pid: 5810 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.510554:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875954704070400:0@lo:104: 00010000:00010000:0.0:1789049919.510572:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.510581:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.510587:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.510593:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031800/0x9df728c939b78924 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049919.510610:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789049919.511620:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704070912:0@lo:103: 00000100:00100000:2.0:1789049919.511631:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704070784:0@lo:103: 00000100:00100000:3.0:1789049919.514590:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704070528:0@lo:103: 00000100:00100000:3.0:1789049919.521810:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704070656:0@lo:103: 00000100:00100000:3.0:1789049919.557241:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:7619:x1875954704069760:12345-0@lo:253: Request processed in 60629us (61310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.557265:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789049919.557862:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704069760:0@lo:253: 10000000:01000000:1.0:1789049919.557878:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789049919.557881:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049919.557883:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049919.557885:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049919.557886:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789049919.557887:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049919.557888:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049919.557890:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049919.557892:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789049919.557893:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049919.557895:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789049919.558161:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95073d0e4000 from lustre-OST0001 10000000:01000000:0.0:1789049919.558185:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789049919.558189:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789049919.558196:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff950706403380 local copy 10000000:01000000:0.0:1789049919.558216:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049919.558250:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.558394:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.558404:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.558422:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071168:0@lo:101: 00000100:00100000:0.0:1789049919.558463:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049919.558546:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706449300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.558588:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071168 00000100:00100000:3.0:1789049919.558595:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071168 00000100:00100000:3.0:1789049919.558671:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789049919.558680:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+11:7619:x1875954704071168:12345-0@lo:101: 00010000:00010000:3.0:1789049919.558691:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049919.558704:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd24c00/0x9df728c939b78932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7892b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.558725:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd24c00/0x9df728c939b78932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7892b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.558735:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd24c00/0x9df728c939b78932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7892b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.558751:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd24c00, rc 0) 00000100:00100000:3.0:1789049919.558797:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071168:12345-0@lo:101: Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.558803:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789049919.558871:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071168:0@lo:101: 00010000:00010000:1.0:1789049919.558884:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.558893:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.559005:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071296:0@lo:501: 00000100:00100000:1.0:1789049919.559031:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.559742:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049919.559814:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071296 00000100:00100000:0.0:1789049919.559820:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071296 00000100:00100000:0.0:1789049919.559849:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789049919.559856:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071296:12345-0@lo:501: 00000100:00100000:0.0:1789049919.560091:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071296:12345-0@lo:501: Request processed in 234us (1057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049919.560099:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789049919.560245:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071296:0@lo:501: 10000000:01000000:1.0:1789049919.560274:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789049919.560312:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789049919.560319:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.560329:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.560336:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.560368:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049919.560392:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95073d0e4000 10000000:01000000:1.0:1789049919.560397:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049919.560401:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789049919.560404:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049919.560408:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789049919.560412:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789049919.560451:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.560459:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.560467:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.560480:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071424:0@lo:101: 00000100:00100000:1.0:1789049919.560520:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.560542:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b900 going to sleep for 11 seconds 00010000:00010000:0.0:1789049919.560957:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049919.560964:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.560983:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789049919.560987:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.560995:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049919.561002:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049919.561009:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049919.561027:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561033:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049919.561061:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561069:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031800/0x9df728c939b7892b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9df728c939b78932 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561083:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049919.561084:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049919.561086:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049919.561098:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071424 00000100:00100000:0.0:1789049919.561102:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071424 00000100:00100000:0.0:1789049919.561126:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049919.561132:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071424:12345-0@lo:101: 00010000:00010000:0.0:1789049919.561142:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049919.561158:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78939 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561176:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78939 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561186:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78939 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.561194:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700030200, rc 0) 00000100:00100000:0.0:1789049919.561565:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704071424:12345-0@lo:101: Request processed in 431us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.561572:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789049919.561757:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704071552:0@lo:103: 00000100:00100000:1.0:1789049919.561791:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.561856:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071424:0@lo:101: 00010000:00010000:1.0:1789049919.561870:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.561880:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.561989:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071680:0@lo:501: 00000100:00100000:1.0:1789049919.562015:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.562028:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789049919.562187:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071680 00000100:00100000:0.0:1789049919.562193:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071680 00000100:00100000:0.0:1789049919.562241:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789049919.562248:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704071680:12345-0@lo:501: 00000100:00100000:0.0:1789049919.562495:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704071680:12345-0@lo:501: Request processed in 246us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.562501:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789049919.562528:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071552 00000100:00100000:0.0:1789049919.562533:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071552 00000100:00100000:0.0:1789049919.562558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049919.562565:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3283:x1875954704071552:12345-0@lo:103: 00010000:00010000:0.0:1789049919.562574:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049919.562590:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd24c00/0x9df728c939b78932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b7892b expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.562603:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049919.562635:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3283:x1875954704071552:12345-0@lo:103: Request processed in 71us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.562641:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049919.562893:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704071552:0@lo:103: 00000100:00100000:1.0:1789049919.563047:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071680:0@lo:501: 00000100:00100000:1.0:1789049919.563085:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071808:0@lo:503: 00000100:00100000:1.0:1789049919.563130:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.563163:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.563249:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071808 00000100:00100000:3.0:1789049919.563254:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071808 00000100:00100000:3.0:1789049919.563427:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789049919.563437:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071808:12345-0@lo:503: 00000100:00100000:3.0:1789049919.563647:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071808:12345-0@lo:503: Request processed in 212us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.563654:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789049919.564195:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071808:0@lo:503: 00000040:00080000:1.0:1789049919.565652:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049919.565737:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071936:0@lo:502: 00000100:00100000:1.0:1789049919.565795:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.566053:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.566105:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704071936 00000100:00100000:3.0:1789049919.566111:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704071936 00000100:00100000:3.0:1789049919.566188:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789049919.566213:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071936:12345-0@lo:502: 00000100:00100000:3.0:1789049919.566482:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704071936:12345-0@lo:502: Request processed in 286us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.566490:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789049919.566575:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704071936:0@lo:502: 00000040:00080000:1.0:1789049919.566806:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789049919.566868:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789049919.566898:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789049919.567136:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789049919.567176:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789049919.567240:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789049919.567269:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072064:0@lo:502: 00000100:00100000:1.0:1789049919.567396:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.567582:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789049919.567647:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072064 00000100:00100000:0.0:1789049919.567653:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072064 00000100:00100000:0.0:1789049919.567684:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789049919.567691:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704072064:12345-0@lo:502: 00000100:00100000:0.0:1789049919.568101:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704072064:12345-0@lo:502: Request processed in 409us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.568108:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049919.568184:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072064:0@lo:502: 00000040:00080000:1.0:1789049919.568406:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789049919.568418:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789049919.568705:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789049919.568712:0:7625:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789049919.568718:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049919.568720:0:7625:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789049919.568725:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789049919.568739:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95073d228000) 00000020:00000080:1.0:1789049919.568757:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789049919.568763:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789049919.569062:0:7625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95073d0e4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789049919.569070:0:7625:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789049919.569076:0:7625:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b7894e 00010000:00010000:1.0:1789049919.582429:0:7625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789049919.582696:0:7625:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789049919.586096:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789049919.586793:0:7625:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789049919.596705:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789049919.599868:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789049919.611520:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789049919.611533:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049919.611538:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049919.611540:0:7625:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789049919.611544:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049919.611548:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049919.611549:0:7625:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049919.611552:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049919.611554:0:7625:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789049919.611609:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049919.611613:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049919.611614:0:7625:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789049919.611617:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789049919.611849:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789049919.611876:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789049919.611899:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.611911:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049919.611948:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95073d0e4000 from 1 10000000:01000000:3.0:1789049919.611951:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049919.611984:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.611993:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.612005:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049919.612028:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072192:0@lo:101: 00000100:00100000:3.0:1789049919.612098:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.612140:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789049919.613721:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072192 00000100:00100000:0.0:1789049919.613733:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072192 00000100:00100000:0.0:1789049919.613795:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789049919.613805:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:7619:x1875954704072192:12345-0@lo:101: 00010000:00010000:0.0:1789049919.613847:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049919.613862:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78955 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.613886:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78955 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.613896:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78955 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.613905:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031800, rc 0) 00000100:00100000:0.0:1789049919.614175:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072192:12345-0@lo:101: Request processed in 372us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.614184:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789049919.617986:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072192:0@lo:101: 00010000:00010000:2.0:1789049919.618015:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049919.618027:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049919.618151:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072320:0@lo:501: 00000100:00100000:2.0:1789049919.618224:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.618264:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049919.618300:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072320 00000100:00100000:2.0:1789049919.618307:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072320 00000100:00100000:2.0:1789049919.618347:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789049919.618356:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072320:12345-0@lo:501: 00000100:00100000:2.0:1789049919.618584:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072320:12345-0@lo:501: Request processed in 229us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.618591:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789049919.618634:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072320:0@lo:501: 00000100:00100000:2.0:1789049919.618665:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072448:0@lo:503: 00000100:00100000:2.0:1789049919.618702:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.618715:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.618990:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072448 00000100:00100000:3.0:1789049919.618996:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072448 00000100:00100000:3.0:1789049919.619027:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789049919.619034:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072448:12345-0@lo:503: 00000100:00100000:3.0:1789049919.619351:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072448:12345-0@lo:503: Request processed in 316us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.619368:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789049919.619689:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072448:0@lo:503: 00000040:00080000:2.0:1789049919.620158:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049919.620254:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072576:0@lo:502: 00000100:00100000:2.0:1789049919.621705:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.621746:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049919.621774:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072576 00000100:00100000:2.0:1789049919.621782:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072576 00000100:00100000:2.0:1789049919.624431:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789049919.624454:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072576:12345-0@lo:502: 00000100:00100000:2.0:1789049919.624731:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072576:12345-0@lo:502: Request processed in 288us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.624739:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789049919.634279:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072576:0@lo:502: 00000040:00080000:3.0:1789049919.634593:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789049919.634650:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789049919.634688:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072704:0@lo:502: 00000100:00100000:3.0:1789049919.634755:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.634792:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507035a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.634836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072704 00000100:00100000:3.0:1789049919.634843:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072704 00000100:00100000:3.0:1789049919.634884:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789049919.634895:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072704:12345-0@lo:502: 00000100:00100000:3.0:1789049919.635604:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072704:12345-0@lo:502: Request processed in 708us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.635613:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789049919.635708:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072704:0@lo:502: 00000040:00080000:1.0:1789049919.636576:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789049919.636591:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00010000:00010000:1.0:1789049919.637173:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789049919.637696:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049919.637705:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049919.637707:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789049919.637715:0:7629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95073d0e4000 00000020:00000080:1.0:1789049919.637717:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049919.637736:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049919.637740:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049919.637741:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789049919.637744:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789049919.637942:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789049919.637963:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049919.637984:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049919.637995:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049919.638035:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789049919.638038:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95073d0e4000 10000000:01000000:2.0:1789049919.638040:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95073d0e4000 10000000:01000000:2.0:1789049919.638044:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789049919.638060:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95073d0e4000 from 1 10000000:01000000:2.0:1789049919.638062:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049919.638091:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049919.638099:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049919.638110:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049919.638130:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072832:0@lo:101: 00000100:00100000:2.0:1789049919.638186:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.638235:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.638527:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072832 00000100:00100000:3.0:1789049919.638534:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072832 00000100:00100000:3.0:1789049919.638583:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789049919.638592:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704072832:12345-0@lo:101: 00010000:00010000:3.0:1789049919.638604:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049919.638615:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78963 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.638636:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78963 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.638646:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78963 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.638654:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25400, rc 0) 00000100:00100000:3.0:1789049919.638699:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704072832:12345-0@lo:101: Request processed in 109us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.638706:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789049919.638786:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072832:0@lo:101: 00010000:00010000:1.0:1789049919.638801:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.638809:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.638891:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072960:0@lo:501: 00000100:00100000:1.0:1789049919.638919:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.638956:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.639053:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704072960 00000100:00100000:3.0:1789049919.639058:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704072960 00000100:00100000:3.0:1789049919.639087:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789049919.639094:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704072960:12345-0@lo:501: 00000100:00100000:3.0:1789049919.639344:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704072960:12345-0@lo:501: Request processed in 249us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.639351:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789049919.639560:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704072960:0@lo:501: 00000100:00100000:1.0:1789049919.639589:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073088:0@lo:503: 00000100:00100000:1.0:1789049919.639632:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.639661:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.639736:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073088 00000100:00100000:3.0:1789049919.639741:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073088 00000100:00100000:3.0:1789049919.639772:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789049919.639779:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073088:12345-0@lo:503: 00000100:00100000:3.0:1789049919.639922:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073088:12345-0@lo:503: Request processed in 143us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.639928:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789049919.640064:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073088:0@lo:503: 00000040:00080000:1.0:1789049919.640628:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049919.640686:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073216:0@lo:502: 00000100:00100000:1.0:1789049919.640730:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.640872:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.641169:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073216 00000100:00100000:3.0:1789049919.641176:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073216 00000100:00100000:3.0:1789049919.641239:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789049919.641248:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073216:12345-0@lo:502: 00000100:00100000:3.0:1789049919.641474:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073216:12345-0@lo:502: Request processed in 226us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.641481:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789049919.641842:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073216:0@lo:502: 00000040:00080000:1.0:1789049919.642114:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789049919.642164:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789049919.642194:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789049919.642269:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789049919.643852:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789049919.644066:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789049919.644108:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789049919.644168:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789049919.645575:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789049919.645656:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789049919.645692:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789049919.645769:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789049919.645809:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789049919.645852:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789049919.645897:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789049919.646067:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789049919.646104:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789049919.646153:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789049919.646188:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789049919.646649:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789049919.646703:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789049919.646740:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789049919.646776:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789049919.646825:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789049919.646864:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789049919.647130:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789049919.647440:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789049919.647481:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789049919.647511:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789049919.647575:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789049919.647614:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789049919.647648:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789049919.647681:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789049919.647724:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789049919.647759:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789049919.647803:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789049919.647839:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789049919.647882:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073344:0@lo:502: 00000100:00100000:0.0:1789049919.648083:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049919.648187:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706449d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049919.648666:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073344 00000100:00100000:3.0:1789049919.648675:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073344 00000100:00100000:3.0:1789049919.648718:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789049919.648727:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073344:12345-0@lo:502: 00000100:00100000:3.0:1789049919.649142:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073344:12345-0@lo:502: Request processed in 414us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049919.649151:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789049919.649614:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073344:0@lo:502: 00000040:00080000:1.0:1789049919.649711:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789049919.649725:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789049919.650592:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789049919.650607:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff950703458000) 00000020:00000080:3.0:1789049919.650626:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789049919.650696:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95073d0e4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049919.650700:0:7630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95073d0e4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049919.650702:0:7630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95073d0e4000 3 00010000:00080000:3.0:1789049919.650729:0:7630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950604db9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.101@tcp at head 00010000:00010000:2.0:1789049919.653861:0:7630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789049919.654292:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789049919.654332:0:7630:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789049919.654345:0:7630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9df728c939b78978 00000100:00080000:2.0:1789049919.654367:0:7630:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049919.654379:0:7630:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950604db9800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789049919.654414:0:7630:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720825500 x1875954704073472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049919.654447:0:7630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789049919.654681:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704073472:0@lo:38: 00000100:00100000:3.0:1789049919.654748:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049919.654850:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073472 00000100:00100000:2.0:1789049919.654858:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073472 00000100:00100000:2.0:1789049919.654896:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049919.654903:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704073472:12345-0@lo:38: 00010000:00080000:2.0:1789049919.654942:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1789049919.654970:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9df728c939b7897f 00000004:00100000:2.0:1789049919.654994:0:5819:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789049919.655023:0:5819:0:(import.c:65:import_set_state_nolock()) ffff95070633b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049919.655077:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875954704073472:12345-0@lo:38: Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.655085:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789049919.655124:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720825500 x1875954704073472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049919.655133:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049919.655140:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789049919.655146:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789049919.655149:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049919.655152:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789049919.655157:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704073472:0@lo:38: 00000040:00080000:2.0:1789049919.660830:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789049919.661050:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789049919.661076:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049919.661093:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049919.661104:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789049919.661154:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789049919.661156:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049919.661158:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049919.661159:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049919.661160:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049919.661162:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049919.661163:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049919.661165:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049919.661166:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049919.661168:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049919.661169:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049919.661172:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789049919.661175:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049919.661176:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049919.661177:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049919.661179:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049919.661180:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049919.661181:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049919.661182:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049919.661183:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049919.661184:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049919.661190:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049919.661191:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049919.661251:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789049919.661276:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073600:0@lo:253: 00000100:00100000:3.0:1789049919.661381:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049919.661415:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032ea300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049919.661652:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073600 00000100:00100000:2.0:1789049919.661659:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073600 00000100:00100000:2.0:1789049919.661697:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789049919.661705:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7619:x1875954704073600:12345-0@lo:253: 20000000:01000000:2.0:1789049919.661729:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789049919.661742:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789049919.667255:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7631:1875954704073728:0@lo:901: 00000100:00100000:1.0:1789049919.667333:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.667383:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049919.667530:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073728 00000100:00100000:2.0:1789049919.667538:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073728 00000100:00100000:2.0:1789049919.667600:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049919.667608:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1875954704073728:12345-0@lo:901: 00000100:00100000:2.0:1789049919.667978:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1875954704073728:12345-0@lo:901: Request processed in 369us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.667986:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789049919.670300:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049919.670366:0:7631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3b80 x1875954704073728/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789049935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049919.670383:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7631:1875954704073728:0@lo:901: 20000000:01000000:2.0:1789049919.710152:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789049919.710171:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789049919.710853:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789049919.710873:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789049919.710895:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.710913:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.710921:0:5833:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.710972:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.710985:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.710998:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704073856:0@lo:104: 00000100:00100000:1.0:1789049919.711059:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049919.711107:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049919.711167:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073856 00000100:00100000:2.0:1789049919.711175:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073856 00000100:00100000:2.0:1789049919.711257:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049919.711267:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704073856:12345-0@lo:104: 00010000:00010000:2.0:1789049919.711290:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049919.711343:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049919.711349:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:5833:x1875954704073856:12345-0@lo:104: Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.711355:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789049919.711695:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049919.711703:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.711711:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fc00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789049919.711715:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.711723:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049919.711730:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049919.711736:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049919.711770:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.711785:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049919.711804:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.711811:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05fc00/0x9df728c939b788d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b788d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.711836:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049919.711838:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049919.711839:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049919.711852:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704073984:0@lo:103: 00000100:00100000:0.0:1789049919.711888:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049919.712030:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704073984 00000100:00100000:0.0:1789049919.712036:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704073984 00010000:00010000:0.0:1789049919.712056:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 15 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049919.712077:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049919.712084:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:3284:x1875954704073984:12345-0@lo:103: 00010000:00010000:0.0:1789049919.712093:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049919.712098:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 15 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712108:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 15 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712123:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712141:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049919.712154:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004976093s 00010000:00010000:0.0:1789049919.712159:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712166:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712172:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712179:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712184:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789049919.712187:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712194:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712233:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049919.712244:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049919.712277:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:3284:x1875954704073984:12345-0@lo:103: Request processed in 193us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049919.712421:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049919.712489:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704073984:0@lo:103: 00010000:00010000:1.0:1789049919.712588:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05f800/0x9df728c939b788d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b788d0 expref: 14 pid: 5811 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049919.712603:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875954704073856:0@lo:104: 00010000:00010000:1.0:1789049919.712621:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.712631:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.712638:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049919.712660:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05e000/0x9df728c939b78986 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049919.734497:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:7619:x1875954704073600:12345-0@lo:253: Request processed in 72786us (73108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049919.734513:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789049919.734665:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7619:1875954704073600:0@lo:253: 10000000:01000000:3.0:1789049919.734682:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789049919.734685:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049919.734686:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789049919.734688:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049919.734689:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049919.734690:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049919.734692:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049919.734693:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049919.734695:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049919.734696:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049919.734698:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049919.734699:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789049919.734713:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789049919.751593:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049919.751800:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049919.752056:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049919.752246:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049919.752486:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049919.752706:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789049919.759756:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789049920.058085:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789049920.058100:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789049920.058138:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049920.058218:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049920.058252:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789049920.058289:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789049920.653371:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049921.675503:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049922.699329:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049923.724145:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049924.239642:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704074112:0@lo:13: 00000100:00100000:1.0:1789049924.239710:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049924.240013:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074112 00000100:00100000:3.0:1789049924.240022:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074112 00000100:00100000:3.0:1789049924.240075:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049924.240086:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704074112:12345-0@lo:13: 00002000:00000024:3.0:1789049924.240118:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049924.240167:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704074112:12345-0@lo:13: Request processed in 84us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049924.240174:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789049924.240218:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049924.240247:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3b80 x1875954704074112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049924.240265:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704074112:0@lo:13: 00010000:00010000:1.0:1789049924.748254:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049924.748428:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704074496:0@lo:400: 00000100:00100000:2.0:1789049924.748489:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049924.748542:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049924.748548:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704074624:0@lo:400: 00000100:00100000:2.0:1789049924.748571:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049924.748615:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074496 00000100:00100000:2.0:1789049924.748621:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074496 00000100:00100000:2.0:1789049924.748667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074624 00000100:00100000:2.0:1789049924.748670:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074624 00000100:00100000:2.0:1789049924.748687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049924.748695:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704074496:12345-0@lo:400: 00000100:00100000:2.0:1789049924.748747:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704074496:12345-0@lo:400: Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049924.748753:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049924.748768:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049924.748774:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704074624:12345-0@lo:400: 00000100:00100000:2.0:1789049924.748801:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704074624:12345-0@lo:400: Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049924.748807:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789049924.748824:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049924.748853:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720827800 x1875954704074624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049924.748866:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704074624:0@lo:400: 00010000:00080000:2.0:1789049924.748878:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720825880 x1875954704074496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049924.748885:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704074496:0@lo:400: 00000100:00100000:1.0:1789049924.749038:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704074240:0@lo:400: 00000100:00100000:1.0:1789049924.749074:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049924.749099:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049924.749105:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704074368:0@lo:400: 00000100:00100000:1.0:1789049924.749125:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049924.749235:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074240 00000100:00100000:3.0:1789049924.749239:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074240 00000100:00100000:3.0:1789049924.749268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789049924.749275:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3282:x1875954704074240:12345-0@lo:400: 00000100:00100000:3.0:1789049924.749307:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3282:x1875954704074240:12345-0@lo:400: Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049924.749313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789049924.749385:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074368 00000100:00100000:2.0:1789049924.749390:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074368 00000100:00100000:2.0:1789049924.749423:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049924.749429:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704074368:12345-0@lo:400: 00000100:00100000:2.0:1789049924.749458:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704074368:12345-0@lo:400: Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049924.749473:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789049924.749567:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720824000 x1875954704074368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049924.749576:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704074368:0@lo:400: 00000100:00100000:1.0:1789049924.749584:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704074240:0@lo:400: 00010000:00010000:0.0:1789049925.771383:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789049926.284254:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049926.284261:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95071009a800 from 30 10000000:01000000:0.0:1789049926.284266:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049926.284315:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.284338:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.284348:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.284370:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704074752:0@lo:101: 00000100:00100000:0.0:1789049926.284449:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.284505:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.284643:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074752 00000100:00100000:2.0:1789049926.284651:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074752 00000100:00100000:2.0:1789049926.284704:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789049926.284714:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704074752:12345-0@lo:101: 00010000:00010000:2.0:1789049926.284726:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049926.284738:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7898d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.284761:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7898d expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.284772:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7898d expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.284780:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0e400, rc 0) 00000100:00100000:2.0:1789049926.284819:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704074752:12345-0@lo:101: Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.284826:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789049926.284918:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704074752:0@lo:101: 00010000:00010000:0.0:1789049926.284935:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.284944:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.284994:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704074880:0@lo:501: 00000100:00100000:0.0:1789049926.285021:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.285046:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.285101:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704074880 00000100:00100000:2.0:1789049926.285106:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704074880 00000100:00100000:2.0:1789049926.285139:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789049926.285145:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704074880:12345-0@lo:501: 00000100:00100000:2.0:1789049926.285494:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704074880:12345-0@lo:501: Request processed in 348us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.285501:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789049926.285957:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704074880:0@lo:501: 00000100:00100000:0.0:1789049926.285989:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075008:0@lo:503: 00000100:00100000:0.0:1789049926.286028:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.286062:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.286792:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075008 00000100:00100000:2.0:1789049926.286799:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075008 00000100:00100000:2.0:1789049926.286851:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789049926.286859:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704075008:12345-0@lo:503: 00000100:00100000:2.0:1789049926.287173:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704075008:12345-0@lo:503: Request processed in 315us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.287181:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789049926.287315:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075008:0@lo:503: 00000100:00100000:0.0:1789049926.287557:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7935:1875954704075136:0@lo:502: 00000100:00100000:0.0:1789049926.287595:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.287621:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075136 00000100:00100000:0.0:1789049926.287625:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075136 00000100:00100000:0.0:1789049926.287647:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789049926.287654:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7935:x1875954704075136:12345-0@lo:502: 00000100:00100000:0.0:1789049926.287873:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7935:x1875954704075136:12345-0@lo:502: Request processed in 219us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.287880:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789049926.287915:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.287928:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7935:1875954704075136:0@lo:502: 00000100:00100000:0.0:1789049926.287965:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7935:1875954704075264:0@lo:502: 00000100:00100000:0.0:1789049926.287998:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.288016:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075264 00000100:00100000:0.0:1789049926.288019:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075264 00000100:00100000:0.0:1789049926.288036:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789049926.288042:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7935:x1875954704075264:12345-0@lo:502: 00000100:00100000:0.0:1789049926.288158:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:7935:x1875954704075264:12345-0@lo:502: Request processed in 116us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.288165:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789049926.288196:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.288231:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7935:1875954704075264:0@lo:502: 00000040:00080000:0.0:1789049926.288248:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789049926.288296:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789049926.288318:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049926.288336:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288346:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049926.288354:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789049926.288357:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789049926.288359:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049926.288380:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288388:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288584:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.288597:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075392:0@lo:101: 00000100:00100000:0.0:1789049926.288623:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.288637:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.288649:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075392 00000100:00100000:0.0:1789049926.288652:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075392 00000100:00100000:0.0:1789049926.288669:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789049926.288675:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704075392:12345-0@lo:101: 00010000:00010000:0.0:1789049926.288688:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049926.288699:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7899b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288718:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7899b expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288728:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7899b expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288736:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031600, rc 0) 00000100:00100000:0.0:1789049926.288762:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704075392:12345-0@lo:101: Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.288768:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789049926.288793:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075392:0@lo:101: 00010000:00010000:0.0:1789049926.288805:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.288814:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.288847:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075520:0@lo:501: 00000100:00100000:0.0:1789049926.288870:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.288881:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.288892:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075520 00000100:00100000:0.0:1789049926.288895:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075520 00000100:00100000:0.0:1789049926.288910:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789049926.288916:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704075520:12345-0@lo:501: 00000100:00100000:0.0:1789049926.289122:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704075520:12345-0@lo:501: Request processed in 204us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.289129:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789049926.289157:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075520:0@lo:501: 00000100:00100000:0.0:1789049926.289179:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075648:0@lo:503: 00000100:00100000:0.0:1789049926.289232:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.289246:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.289257:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075648 00000100:00100000:0.0:1789049926.289260:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075648 00000100:00100000:0.0:1789049926.289277:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789049926.289282:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704075648:12345-0@lo:503: 00000100:00100000:0.0:1789049926.290345:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704075648:12345-0@lo:503: Request processed in 1059us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.290354:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789049926.290535:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704075648:0@lo:503: 00000100:00100000:2.0:1789049926.290943:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7936:1875954704075776:0@lo:502: 00000100:00100000:2.0:1789049926.290991:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.291028:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.291077:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075776 00000100:00100000:0.0:1789049926.291083:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075776 00000100:00100000:0.0:1789049926.291130:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789049926.291138:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7936:x1875954704075776:12345-0@lo:502: 00000100:00100000:0.0:1789049926.291347:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7936:x1875954704075776:12345-0@lo:502: Request processed in 210us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.291354:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789049926.291501:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7936:1875954704075776:0@lo:502: 00000020:01000000:2.0:1789049926.291524:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049926.291533:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049926.291535:0:7936:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789049926.291539:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049926.291541:0:7936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789049926.291556:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7936:1875954704075904:0@lo:502: 00000100:00100000:2.0:1789049926.291586:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.291606:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.291732:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704075904 00000100:00100000:0.0:1789049926.291737:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704075904 00000100:00100000:0.0:1789049926.291765:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789049926.291772:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7936:x1875954704075904:12345-0@lo:502: 00000100:00100000:0.0:1789049926.291883:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:7936:x1875954704075904:12345-0@lo:502: Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.291895:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789049926.291967:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7936:1875954704075904:0@lo:502: 00000020:01000000:2.0:1789049926.291986:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049926.291992:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049926.291993:0:7936:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789049926.291997:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789049926.292280:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789049926.292296:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049926.292305:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.292316:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049926.292333:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049926.292335:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950707961800 from 30 10000000:01000000:0.0:1789049926.292338:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049926.292360:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.292368:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.292376:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.292389:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076032:0@lo:101: 00000100:00100000:0.0:1789049926.292493:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.292558:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.295664:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076032 00000100:00100000:2.0:1789049926.295679:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076032 00000100:00100000:2.0:1789049926.295789:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789049926.295800:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704076032:12345-0@lo:101: 00010000:00010000:2.0:1789049926.295839:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049926.295858:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b789a9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.295886:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b789a9 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.295898:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789a9 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049926.295907:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0e800, rc 0) 00000100:00100000:2.0:1789049926.295980:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076032:12345-0@lo:101: Request processed in 182us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.295987:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789049926.296081:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076032:0@lo:101: 00010000:00010000:3.0:1789049926.296112:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.296122:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049926.296186:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076160:0@lo:501: 00000100:00100000:3.0:1789049926.296238:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049926.304377:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.306233:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076160 00000100:00100000:0.0:1789049926.306246:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076160 00000100:00100000:0.0:1789049926.306296:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789049926.306307:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076160:12345-0@lo:501: 00000100:00100000:0.0:1789049926.306613:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076160:12345-0@lo:501: Request processed in 307us (10373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.306627:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789049926.306696:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076160:0@lo:501: 00000100:00100000:0.0:1789049926.306744:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076288:0@lo:503: 00000100:00100000:0.0:1789049926.306790:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.306819:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.306831:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076288 00000100:00100000:0.0:1789049926.306835:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076288 00000100:00100000:0.0:1789049926.306852:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789049926.306859:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076288:12345-0@lo:503: 00000100:00100000:0.0:1789049926.306994:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076288:12345-0@lo:503: Request processed in 135us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.307000:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789049926.307037:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076288:0@lo:503: 00000100:00100000:0.0:1789049926.317355:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7937:1875954704076416:0@lo:502: 00000100:00100000:0.0:1789049926.317434:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.317476:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789049926.317620:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076416 00000100:00100000:1.0:1789049926.317628:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076416 00000100:00100000:1.0:1789049926.317677:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789049926.317686:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:7937:x1875954704076416:12345-0@lo:502: 00000100:00100000:1.0:1789049926.317902:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:7937:x1875954704076416:12345-0@lo:502: Request processed in 217us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.317911:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789049926.317997:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7937:1875954704076416:0@lo:502: 00000100:00100000:0.0:1789049926.318045:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7937:1875954704076544:0@lo:502: 00000100:00100000:0.0:1789049926.318083:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.319504:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fad780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049926.321604:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076544 00000100:00100000:1.0:1789049926.321624:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076544 00000100:00100000:1.0:1789049926.321680:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789049926.321690:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:7937:x1875954704076544:12345-0@lo:502: 00000100:00100000:1.0:1789049926.322047:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:7937:x1875954704076544:12345-0@lo:502: Request processed in 357us (3961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.322054:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789049926.327055:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7937:1875954704076544:0@lo:502: 00000040:00080000:0.0:1789049926.327761:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789049926.328031:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789049926.328053:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049926.328063:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.328093:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049926.328103:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789049926.328106:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950707961800 from 5 10000000:01000000:3.0:1789049926.328109:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049926.328142:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.328150:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.328159:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049926.328178:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076672:0@lo:101: 00000100:00100000:3.0:1789049926.328572:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049926.328648:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.328756:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076672 00000100:00100000:0.0:1789049926.328763:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076672 00000100:00100000:0.0:1789049926.328841:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789049926.328851:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704076672:12345-0@lo:101: 00010000:00010000:0.0:1789049926.328871:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049926.328884:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700031c00/0x9df728c939b789be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b789b7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.328925:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031c00/0x9df728c939b789be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b789b7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.328937:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700031c00/0x9df728c939b789be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789b7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.328945:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031c00, rc 0) 00000100:00100000:0.0:1789049926.328986:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704076672:12345-0@lo:101: Request processed in 137us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.328993:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789049926.329272:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076672:0@lo:101: 00010000:00010000:0.0:1789049926.329289:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.329411:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.329462:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076800:0@lo:256: 00000100:00100000:0.0:1789049926.329500:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.329562:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049926.329595:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076800 00000100:00100000:3.0:1789049926.329600:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076800 00000100:00100000:3.0:1789049926.329737:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789049926.329747:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704076800:12345-0@lo:256: 20000000:01000000:3.0:1789049926.329763:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789049926.329781:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789049926.329784:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789049926.329864:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704076800:12345-0@lo:256: Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049926.329872:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789049926.330990:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076800:0@lo:256: 10000000:01000000:0.0:1789049926.331040:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049926.331048:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331062:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049926.331072:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789049926.331074:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789049926.331077:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049926.331106:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331114:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331124:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.331140:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076928:0@lo:101: 00000100:00100000:0.0:1789049926.331180:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.331227:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.331244:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704076928 00000100:00100000:0.0:1789049926.331249:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704076928 00000100:00100000:0.0:1789049926.331279:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789049926.331287:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704076928:12345-0@lo:101: 00010000:00010000:0.0:1789049926.331474:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049926.331487:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b789c5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331510:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b789c5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331533:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789c5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331542:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700030600, rc 0) 00000100:00100000:0.0:1789049926.331579:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704076928:12345-0@lo:101: Request processed in 293us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.331586:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789049926.331617:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704076928:0@lo:101: 00010000:00010000:0.0:1789049926.331629:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.331637:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.331688:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704077056:0@lo:501: 00000100:00100000:0.0:1789049926.331713:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.331726:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.331737:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077056 00000100:00100000:0.0:1789049926.331741:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077056 00000100:00100000:0.0:1789049926.331756:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049926.331761:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704077056:12345-0@lo:501: 00000100:00100000:0.0:1789049926.332115:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704077056:12345-0@lo:501: Request processed in 352us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.332123:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049926.332154:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704077056:0@lo:501: 00000100:00100000:0.0:1789049926.332180:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704077184:0@lo:503: 00000100:00100000:0.0:1789049926.332239:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.332253:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.332264:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077184 00000100:00100000:0.0:1789049926.332268:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077184 00000100:00100000:0.0:1789049926.332284:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789049926.332290:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704077184:12345-0@lo:503: 00000100:00100000:0.0:1789049926.332657:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704077184:12345-0@lo:503: Request processed in 366us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.332664:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789049926.332700:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704077184:0@lo:503: 00000100:00100000:0.0:1789049926.332856:0:7940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7940:1875954704077312:0@lo:502: 00000100:00100000:0.0:1789049926.332888:0:7940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.333243:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077312 00000100:00100000:0.0:1789049926.333248:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077312 00000100:00100000:0.0:1789049926.333272:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789049926.333280:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:7940:x1875954704077312:12345-0@lo:502: 00000100:00100000:0.0:1789049926.333606:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:7940:x1875954704077312:12345-0@lo:502: Request processed in 325us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.333613:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789049926.333646:0:7940:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.333724:0:7940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7940:1875954704077312:0@lo:502: 00000020:01000000:0.0:1789049926.333749:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789049926.333756:0:7940:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789049926.333762:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049926.333764:0:7940:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789049926.333769:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789049926.333777:0:7940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:0.0:1789049926.333795:0:7940:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789049926.333797:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789049926.333810:0:7940:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff950706404d40) 00000020:00000080:0.0:1789049926.333829:0:7940:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789049926.333833:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789049926.334089:0:7940:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789049926.334095:0:7940:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789049926.334101:0:7940:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b789da 00010000:00080000:0.0:1789049926.334129:0:7940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950605b8f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:0.0:1789049926.334519:0:7940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789049926.335026:0:7940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789049926.335039:0:7940:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789049926.335813:0:7940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049926.336145:0:7940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049926.336403:0:7940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789049926.336469:0:7940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789049926.337833:0:7942:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049926.337839:0:7942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789049926.338548:0:7940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789049926.338557:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789049926.338585:0:7940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789049926.338603:0:7940:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b789e1 00000100:00080000:2.0:1789049926.338612:0:7940:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049926.338622:0:7940:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff950605b8f000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789049926.338653:0:7940:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720825880 x1875954704077440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049926.338680:0:7940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789049926.338733:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049926.338737:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049926.338739:0:7940:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789049926.338742:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049926.338746:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049926.338747:0:7940:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000100:00100000:0.0:1789049926.338752:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704077440:0@lo:8: 00000020:00000080:2.0:1789049926.338756:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049926.338757:0:7940:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789049926.338778:0:7940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7940:1875954704077568:0@lo:502: 00000100:00100000:2.0:1789049926.338819:0:7940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.338819:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.338851:0:7940:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049926.339111:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704077824:0@lo:400: 00000100:00100000:2.0:1789049926.339160:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704077696:0@lo:400: 00000100:00100000:1.0:1789049926.341102:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049926.341156:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704077952:0@lo:400: 00000100:00100000:1.0:1789049926.341191:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.341384:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077568 00000100:00100000:0.0:1789049926.341393:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077568 00000100:00100000:0.0:1789049926.341436:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789049926.341444:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:7940:x1875954704077568:12345-0@lo:502: 00000100:00100000:1.0:1789049926.341514:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049926.341520:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704078080:0@lo:400: 00000100:00100000:1.0:1789049926.341543:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049926.341572:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077824 00000100:00100000:1.0:1789049926.341575:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077824 00000100:00100000:1.0:1789049926.341607:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078080 00000100:00100000:1.0:1789049926.341610:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078080 00000100:00100000:1.0:1789049926.341623:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049926.341629:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704077824:12345-0@lo:400: 00000100:00100000:1.0:1789049926.341669:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704077824:12345-0@lo:400: Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.341676:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049926.341692:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049926.341698:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704078080:12345-0@lo:400: 00000100:00100000:1.0:1789049926.341728:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704078080:12345-0@lo:400: Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.341733:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049926.341756:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077440 00000100:00100000:1.0:1789049926.341760:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077440 00000100:00100000:1.0:1789049926.341773:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077952 00000100:00100000:1.0:1789049926.341775:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077952 00000100:00100000:1.0:1789049926.341791:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049926.341795:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704077952:12345-0@lo:400: 00000100:00100000:1.0:1789049926.341824:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704077952:12345-0@lo:400: Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.341830:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049926.341839:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049926.341842:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875954704077440:12345-0@lo:8: 00010000:00080000:1.0:1789049926.341862:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1789049926.341885:0:6672:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b789e8 00002000:00100000:1.0:1789049926.341897:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff950605760800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789049926.341901:0:6672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789049926.341904:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789049926.342000:0:6672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789049926.342141:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049926.342162:0:6672:0:(import.c:65:import_set_state_nolock()) ffff950605761800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049926.342194:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:7940:x1875954704077568:12345-0@lo:502: Request processed in 750us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.342216:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704077440:12345-0@lo:8: Request processed in 355us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.342221:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049926.342221:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1789049926.342238:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789049926.342242:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049926.342270:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3b80 x1875954704077824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.342283:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704077824:0@lo:400: 00000100:00100000:2.0:1789049926.342870:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.343043:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704077696 00000100:00100000:2.0:1789049926.343044:0:7940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:7940:1875954704077568:0@lo:502: 00000100:00100000:0.0:1789049926.343053:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704077696 00000020:01000000:2.0:1789049926.343078:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049926.343084:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1789049926.343084:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000020:00000080:2.0:1789049926.343086:0:7940:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789049926.343091:0:7940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789049926.343091:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704077696:12345-0@lo:400: 00000100:00100000:0.0:1789049926.343394:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704077696:12345-0@lo:400: Request processed in 302us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.343401:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:0.0:1789049926.343422:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789049926.343440:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789049926.343449:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.343461:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049926.343471:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789049926.343474:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff950706403380 from 1 10000000:01000000:0.0:1789049926.343478:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049926.343514:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.343523:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049926.343533:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049926.343550:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704078208:0@lo:101: 00000100:00100000:0.0:1789049926.343580:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.343603:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032fc480 going to sleep for 11 seconds 00010000:00080000:3.0:1789049926.343648:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb0a80 x1875954704077696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049926.343740:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704077696:0@lo:400: 00000100:00100000:3.0:1789049926.343762:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078208 00000100:00100000:3.0:1789049926.343766:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078208 00000100:00100000:3.0:1789049926.343798:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789049926.343806:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704078208:12345-0@lo:101: 00010000:00010000:3.0:1789049926.343815:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049926.343826:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b789ef expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.343846:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b789ef expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.343857:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789ef expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.343867:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25200, rc 0) 00000100:00100000:3.0:1789049926.344041:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704078208:12345-0@lo:101: Request processed in 234us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049926.344047:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789049926.344081:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704078208:0@lo:101: 00010000:00010000:3.0:1789049926.344094:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.344266:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049926.344335:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704078336:0@lo:501: 00000100:00100000:3.0:1789049926.344362:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049926.344418:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.344450:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078336 00000100:00100000:0.0:1789049926.344460:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078336 00010000:00080000:1.0:1789049926.344466:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb2d80 x1875954704078080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.344476:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704078080:0@lo:400: 00010000:00080000:1.0:1789049926.344487:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3800 x1875954704077952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.344495:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704077952:0@lo:400: 00000100:00100000:0.0:1789049926.344516:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789049926.344524:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704078336:12345-0@lo:501: 00010000:00080000:1.0:1789049926.344533:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720825880 x1875954704077440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.344541:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789049926.344547:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789049926.344553:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789049926.344557:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789049926.344560:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950605b8f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789049926.344570:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789049926.344574:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704077440:0@lo:8: 00000100:00100000:0.0:1789049926.344884:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704078336:12345-0@lo:501: Request processed in 360us (520us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049926.344891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:0.0:1789049926.344935:0:7942:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789049926.345056:0:7942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 162332855566ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789049926.345442:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704078336:0@lo:501: 10000000:01000000:3.0:1789049926.345472:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789049926.345480:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049926.345488:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049926.420254:0:7944:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789049926.420283:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078592:0@lo:7: 00000100:00100000:1.0:1789049926.421559:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049926.421602:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049926.421622:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704078464:0@lo:13: 00000100:00100000:1.0:1789049926.421647:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049926.421683:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078592 00000100:00100000:1.0:1789049926.421690:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078592 00000100:00100000:1.0:1789049926.421735:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049926.421743:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7944:x1875954704078592:12345-0@lo:7: 00000100:00080000:0.0:1789049926.427298:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049926.427334:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078464 00000100:00100000:0.0:1789049926.427344:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078464 00000100:00100000:0.0:1789049926.427395:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049926.427405:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875954704078464:12345-0@lo:13: 00002000:00000024:0.0:1789049926.427432:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789049926.427510:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875954704078464:12345-0@lo:13: Request processed in 106us (5861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049926.427517:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:1.0:1789049926.428109:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789049926.428114:0:6672:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789049926.428171:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7944:x1875954704078592:12345-0@lo:7: Request processed in 6427us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.428178:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789049926.428254:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3800 x1875954704078464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.428272:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704078464:0@lo:13: 00010000:00080000:0.0:1789049926.428413:0:7944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb2d80 x1875954704078592/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049926.428422:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078592:0@lo:7: 00000004:00080000:0.0:1789049926.428433:0:7944:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789049926.428464:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078720:0@lo:5: 00000100:00100000:0.0:1789049926.428497:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.428536:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.428583:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078720 00000100:00100000:2.0:1789049926.428589:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078720 00000100:00100000:2.0:1789049926.428624:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049926.428633:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1875954704078720:12345-0@lo:5: 00002000:00080000:2.0:1789049926.428651:0:6671:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789049926.428654:0:6671:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789049926.429004:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7944:x1875954704078720:12345-0@lo:5: Request processed in 371us (504us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789049926.429011:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789049926.429082:0:7944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033da680 x1875954704078720/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049926.429094:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078720:0@lo:5: 00000004:00080000:0.0:1789049926.429259:0:7944:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789049926.429283:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078848:0@lo:700: 00000100:00100000:0.0:1789049926.429355:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.429376:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.429509:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078848 00000100:00100000:2.0:1789049926.429514:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078848 00000100:00100000:2.0:1789049926.429550:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049926.429557:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7944:x1875954704078848:12345-0@lo:700: 00000100:00100000:2.0:1789049926.429586:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1875954704078976:0@lo:700: 00000100:00100000:2.0:1789049926.429613:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049926.429631:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049926.429653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704078976 00000100:00100000:2.0:1789049926.429852:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704078976 00000100:00100000:2.0:1789049926.430000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049926.430010:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1875954704078976:12345-0@lo:700: 00000004:00080000:1.0:1789049926.504186:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789049926.566456:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789049926.578386:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1875954704078976:12345-0@lo:700: Request processed in 148372us (148765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049926.578400:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789049926.578769:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720827800 x1875954704078976/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049942 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049926.578784:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1875954704078976:0@lo:700: 40000000:02000000:1.0:1789049926.578799:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1789049926.684556:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7944:x1875954704078848:12345-0@lo:700: Request processed in 254988us (255189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049926.684579:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:1.0:1789049926.684624:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789049926.684634:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:0.0:1789049926.685398:0:7944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033d9c00 x1875954704078848/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049942 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049926.685415:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704078848:0@lo:700: 00000001:02000400:3.0:1789049926.688110:0:7981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:02000040:0.0:1789049926.738992:0:7944:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789049926.746266:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704079104:0@lo:5: 00000100:00100000:0.0:1789049926.746342:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049926.746394:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049926.746991:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079104 00000100:00100000:0.0:1789049926.747000:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079104 00000100:00100000:0.0:1789049926.748230:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049926.748245:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7944:x1875954704079104:12345-0@lo:5: 00002000:00080000:1.0:1789049926.755123:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789049926.755142:0:6672:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789049926.764717:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7944:x1875954704079104:12345-0@lo:5: Request processed in 16470us (18368us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789049926.764730:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789049926.764887:0:7944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033d9c00 x1875954704079104/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049942 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049926.764899:0:7944:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789049926.764913:0:7944:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9507033d9c00 x1875954704079104/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049942 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049926.764923:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7944:1875954704079104:0@lo:5: 00000004:00080000:0.0:1789049926.764936:0:7944:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789049926.795449:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049927.823430:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049928.843477:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049929.355640:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049929.355673:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704079232:0@lo:13: 00000100:00100000:0.0:1789049929.355734:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049929.355845:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079232 00000100:00100000:1.0:1789049929.355854:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079232 00000100:00100000:1.0:1789049929.355915:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049929.355924:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704079232:12345-0@lo:13: 00002000:00000024:1.0:1789049929.355954:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049929.355998:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704079232:12345-0@lo:13: Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049929.356005:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789049929.356042:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3800 x1875954704079232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049929.356058:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704079232:0@lo:13: 00000100:00080000:0.0:1789049929.356120:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789049929.870115:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049930.906423:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049931.405266:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049931.405289:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704079360:0@lo:400: 00000100:00100000:1.0:1789049931.405360:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049931.405423:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704079488:0@lo:400: 00000100:00100000:0.0:1789049931.405753:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079360 00000100:00100000:0.0:1789049931.405761:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079360 00000100:00100000:0.0:1789049931.406047:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789049931.406058:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704079360:12345-0@lo:400: 00000100:00100000:0.0:1789049931.406107:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704079360:12345-0@lo:400: Request processed in 52us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049931.406114:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789049931.406237:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049931.406280:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704079360:0@lo:400: 00000100:00100000:1.0:1789049931.406341:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049931.406345:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079488 00000100:00100000:2.0:1789049931.406351:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079488 00000100:00100000:1.0:1789049931.406352:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704079616:0@lo:400: 00000100:00100000:1.0:1789049931.406382:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049931.406387:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049931.406396:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704079488:12345-0@lo:400: 00000100:00100000:1.0:1789049931.406419:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789049931.406427:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789049931.406445:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704079488:12345-0@lo:400: Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049931.406452:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049931.406463:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079616 00010000:00080000:1.0:1789049931.406464:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb2d80 x1875954704079488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049931.406466:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079616 00000100:00100000:1.0:1789049931.406475:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704079488:0@lo:400: 00000100:00080000:3.0:1789049931.406574:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049931.406581:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049931.406584:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704079744:0@lo:400: 00000100:00100000:2.0:1789049931.406589:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704079616:12345-0@lo:400: 00000100:00100000:2.0:1789049931.406617:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704079616:12345-0@lo:400: Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049931.406623:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049931.407567:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789049931.407782:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d1f80 x1875954704079616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049931.407798:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704079616:0@lo:400: 00000100:00100000:1.0:1789049931.407826:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079744 00000100:00100000:1.0:1789049931.407831:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079744 00000100:00100000:1.0:1789049931.407876:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049931.407884:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704079744:12345-0@lo:400: 00000100:00100000:1.0:1789049931.407925:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704079744:12345-0@lo:400: Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049931.407932:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789049931.407958:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d2d80 x1875954704079744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049931.407968:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704079744:0@lo:400: 00000100:00100000:1.0:1789049931.408001:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049931.408010:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704079872:0@lo:400: 00000100:00100000:1.0:1789049931.408036:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049931.408059:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704079872 00000100:00100000:1.0:1789049931.408063:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704079872 00000100:00100000:1.0:1789049931.408086:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049931.408092:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704079872:12345-0@lo:400: 00000100:00100000:1.0:1789049931.408124:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704079872:12345-0@lo:400: Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049931.408131:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789049931.408154:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d2d80 x1875954704079872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049931.408179:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704079872:0@lo:400: 00000100:00100000:1.0:1789049931.408330:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704080000:0@lo:400: 00000100:00100000:1.0:1789049931.408355:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049931.408381:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080000 00000100:00100000:1.0:1789049931.408385:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080000 00000100:00100000:1.0:1789049931.408407:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049931.408413:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704080000:12345-0@lo:400: 00000100:00100000:1.0:1789049931.408743:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704080000:12345-0@lo:400: Request processed in 328us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049931.408750:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789049931.408778:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d2d80 x1875954704080000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049931.408788:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704080000:0@lo:400: 00000100:00080000:2.0:1789049931.409418:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049931.409423:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049931.409426:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789049931.747781:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789049931.917506:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049931.922365:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704080128:0@lo:13: 00000100:00100000:1.0:1789049931.922436:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049931.926350:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080128 00000100:00100000:0.0:1789049931.926363:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080128 00000100:00100000:0.0:1789049931.926416:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049931.926426:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704080128:12345-0@lo:13: 00002000:00000024:0.0:1789049931.926463:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049931.930268:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704080128:12345-0@lo:13: Request processed in 3837us (7825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049931.930282:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789049931.932714:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720824700 x1875954704080128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049931.932727:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789049931.932751:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704080128:0@lo:13: 00000100:00100000:2.0:1789049932.379854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049932.380101:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691473536 00000100:00100000:3.0:1789049932.380111:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691473536 00000100:00100000:3.0:1789049932.380156:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 112 00000100:00100000:3.0:1789049932.380164:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875954691473536:12345-192.168.206.1@tcp:250: 00010000:00080000:3.0:1789049932.380191:0:5810:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4bb2e670-8cb0-4737-a96d-2c875877eef5@192.168.206.1@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1789049932.380244:0:5810:0:(genops.c:1384:class_connect()) connect: client 4bb2e670-8cb0-4737-a96d-2c875877eef5, cookie 0x9df728c939b789fd 00000100:00080000:3.0:1789049932.380386:0:5810:0:(import.c:65:import_set_state_nolock()) ffff95073d0e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049932.380445:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+5:2346:x1875954691473536:12345-192.168.206.1@tcp:250: Request processed in 280us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049932.380452:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 112 00000100:00100000:3.0:1789049932.382770:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049932.382987:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691473664 00000100:00100000:0.0:1789049932.382996:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691473664 00000100:00100000:0.0:1789049932.383053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 113 00000100:00100000:0.0:1789049932.383063:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+5:5577:x1875954691473664:12345-192.168.206.1@tcp:101: 00010000:00010000:0.0:1789049932.383080:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049932.383097:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f6b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049932.383123:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049932.383146:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049932.383154:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:0.0:1789049932.383237:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+6:5577:x1875954691473664:12345-192.168.206.1@tcp:101: Request processed in 175us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049932.383244:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 113 00000100:00100000:0.0:1789049932.385908:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049932.385995:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691473792 00000100:00100000:2.0:1789049932.386004:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691473792 00000100:00100000:2.0:1789049932.386066:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:2.0:1789049932.386075:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+6:5577:x1875954691473792:12345-192.168.206.1@tcp:501: 00000100:00100000:2.0:1789049932.386466:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+6:5577:x1875954691473792:12345-192.168.206.1@tcp:501: Request processed in 392us (566us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789049932.386474:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:2.0:1789049932.389459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049932.389715:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691473920 00000100:00100000:3.0:1789049932.389725:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691473920 00000100:00100000:3.0:1789049932.389775:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:3.0:1789049932.389784:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+6:5577:x1875954691473920:12345-192.168.206.1@tcp:101: 00010000:00010000:3.0:1789049932.389800:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049932.389816:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f6c0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049932.389843:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049932.389855:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049932.389872:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489c00, rc 0) 00000100:00100000:3.0:1789049932.389980:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+7:5577:x1875954691473920:12345-192.168.206.1@tcp:101: Request processed in 196us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049932.389987:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:3.0:1789049932.395447:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049932.395542:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474048 00000100:00100000:0.0:1789049932.395552:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474048 00000100:00100000:0.0:1789049932.395652:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:0.0:1789049932.395662:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+7:5577:x1875954691474048:12345-192.168.206.1@tcp:501: 00000100:00100000:0.0:1789049932.395939:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5577:x1875954691474048:12345-192.168.206.1@tcp:501: Request processed in 278us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049932.395947:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:1.0:1789049932.401283:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049932.401370:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474176 00000100:00100000:2.0:1789049932.401380:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474176 00000100:00100000:2.0:1789049932.401427:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:2.0:1789049932.401436:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5577:x1875954691474176:12345-192.168.206.1@tcp:503: 00000100:00100000:2.0:1789049932.401806:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5577:x1875954691474176:12345-192.168.206.1@tcp:503: Request processed in 370us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049932.401814:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:2.0:1789049932.406837:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049932.407468:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474304 00000100:00100000:0.0:1789049932.407480:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474304 00000100:00100000:1.0:1789049932.407751:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:1.0:1789049932.407762:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5595:x1875954691474304:12345-192.168.206.1@tcp:502: 00000100:00100000:1.0:1789049932.408114:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5595:x1875954691474304:12345-192.168.206.1@tcp:502: Request processed in 353us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049932.408122:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:1.0:1789049932.433459:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049932.438868:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474432 00000100:00100000:3.0:1789049932.438882:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474432 00000100:00100000:3.0:1789049932.438951:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:3.0:1789049932.438961:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5595:x1875954691474432:12345-192.168.206.1@tcp:502: 00000100:00100000:3.0:1789049932.439511:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5595:x1875954691474432:12345-192.168.206.1@tcp:502: Request processed in 550us (6059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049932.439519:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:0.0:1789049932.450170:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049932.450469:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474560 00000100:00100000:1.0:1789049932.450480:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474560 00000100:00100000:1.0:1789049932.450574:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 120 00000100:00100000:1.0:1789049932.450584:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5577:x1875954691474560:12345-192.168.206.1@tcp:101: 00010000:00010000:1.0:1789049932.450599:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049932.450616:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05fc00/0x9df728c939b78a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f6ea expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.450642:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05fc00/0x9df728c939b78a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6ea expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.450652:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05fc00/0x9df728c939b78a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6ea expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.450660:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05fc00, rc 0) 00000100:00100000:1.0:1789049932.450735:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5577:x1875954691474560:12345-192.168.206.1@tcp:101: Request processed in 152us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049932.450742:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 120 00000100:00100000:1.0:1789049932.455555:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049932.455689:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474688 00000100:00100000:2.0:1789049932.455698:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474688 00000100:00100000:2.0:1789049932.455742:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:2.0:1789049932.455751:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5577:x1875954691474688:12345-192.168.206.1@tcp:256: 20000000:01000000:2.0:1789049932.455773:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789049932.455790:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789049932.455794:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789049932.455797:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789049932.455800:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789049932.463613:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5577:x1875954691474688:12345-192.168.206.1@tcp:256: Request processed in 7851us (8054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049932.463628:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:0.0:1789049932.467051:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049932.467134:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474816 00000100:00100000:1.0:1789049932.467143:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474816 00000100:00100000:1.0:1789049932.467248:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 122 00000100:00100000:1.0:1789049932.467259:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5577:x1875954691474816:12345-192.168.206.1@tcp:101: 00010000:00010000:1.0:1789049932.467304:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049932.467324:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f6f1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.467350:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.467360:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049932.467369:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789049932.467424:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5577:x1875954691474816:12345-192.168.206.1@tcp:101: Request processed in 167us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049932.467430:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 122 00000100:00100000:2.0:1789049932.469646:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049932.469933:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691474944 00000100:00100000:0.0:1789049932.469942:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691474944 00000100:00100000:0.0:1789049932.470144:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:0.0:1789049932.470156:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5577:x1875954691474944:12345-192.168.206.1@tcp:501: 00000100:00100000:0.0:1789049932.470443:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5577:x1875954691474944:12345-192.168.206.1@tcp:501: Request processed in 289us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049932.470451:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:2.0:1789049932.472476:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049932.472568:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475072 00000100:00100000:1.0:1789049932.472577:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475072 00000100:00100000:1.0:1789049932.472658:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00100000:1.0:1789049932.472668:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5577:x1875954691475072:12345-192.168.206.1@tcp:503: 00000100:00100000:1.0:1789049932.473314:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5577:x1875954691475072:12345-192.168.206.1@tcp:503: Request processed in 645us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049932.473323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00100000:1.0:1789049932.477061:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049932.477158:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475200 00000100:00100000:0.0:1789049932.477168:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475200 00000100:00100000:0.0:1789049932.477250:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 125 00000100:00100000:0.0:1789049932.477259:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5600:x1875954691475200:12345-192.168.206.1@tcp:502: 00000100:00100000:0.0:1789049932.477522:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5600:x1875954691475200:12345-192.168.206.1@tcp:502: Request processed in 264us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049932.477530:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 125 00000100:00100000:2.0:1789049932.482927:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049932.483191:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475328 00000100:00100000:1.0:1789049932.483359:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475328 00000100:00100000:0.0:1789049932.483532:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 126 00000100:00100000:0.0:1789049932.483545:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5600:x1875954691475328:12345-192.168.206.1@tcp:502: 00000100:00100000:0.0:1789049932.484019:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5600:x1875954691475328:12345-192.168.206.1@tcp:502: Request processed in 476us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049932.484028:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 126 00000100:00100000:2.0:1789049932.488086:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049932.488176:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475456 00000100:00100000:3.0:1789049932.488185:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475456 00000100:00100000:2.0:1789049932.488447:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789049932.488455:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875954691475456:12345-192.168.206.1@tcp:38: 00010000:00080000:2.0:1789049932.488484:0:5817:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1789049932.488528:0:5817:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78a20 00000004:00100000:2.0:1789049932.488555:0:5817:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789049932.488561:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789049932.515982:0:5817:0:(import.c:65:import_set_state_nolock()) ffff950702ca0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049932.516107:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691475456:12345-192.168.206.1@tcp:38: Request processed in 27649us (28028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049932.516118:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00010000:00010000:3.0:1789049932.939482:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049933.531826:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049933.531875:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049933.531956:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475584 00000100:00100000:2.0:1789049933.531965:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475584 00000100:00100000:2.0:1789049933.532025:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475712 00000100:00100000:2.0:1789049933.532028:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475712 00000100:00100000:2.0:1789049933.532047:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:2.0:1789049933.532056:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:0:x1875954691475584:12345-192.168.206.1@tcp:41: 00000004:00000024:2.0:1789049933.532094:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789049933.532227:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:0:x1875954691475584:12345-192.168.206.1@tcp:41: Request processed in 144us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049933.532235:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:2.0:1789049933.532252:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789049933.532260:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691475712:12345-192.168.206.1@tcp:41: 00000004:00000024:2.0:1789049933.532270:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789049933.532303:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691475712:12345-192.168.206.1@tcp:41: Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049933.532309:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00080000:3.0:1789049933.533084:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049933.538833:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049933.538939:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475840 00000100:00100000:2.0:1789049933.538961:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475840 00000100:00100000:2.0:1789049933.539020:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789049933.539030:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691475840:12345-192.168.206.1@tcp:40: 00000100:00100000:2.0:1789049933.539114:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691475840:12345-192.168.206.1@tcp:40: Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049933.539121:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789049933.544028:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049933.544067:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049933.544102:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049933.544193:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691475968 00000100:00100000:1.0:1789049933.544194:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476096 00000100:00100000:1.0:1789049933.544243:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476096 00000100:00100000:0.0:1789049933.544243:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691475968 00000100:00100000:0.0:1789049933.544296:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789049933.544304:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875954691476096:12345-192.168.206.1@tcp:8: 00010000:00080000:0.0:1789049933.544333:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1789049933.544363:0:6670:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78a27 00002000:00100000:0.0:1789049933.544374:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2c118c85-b079-4c51-87ec-099389ee7be3/ffff950605b8a800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789049933.544400:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789049933.544717:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789049933.544745:0:6670:0:(import.c:65:import_set_state_nolock()) ffff950605b8e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049933.544812:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691476096:12345-192.168.206.1@tcp:8: Request processed in 506us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049933.545464:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476224 00000100:00100000:3.0:1789049933.545471:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476224 00000100:00100000:3.0:1789049933.545514:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789049933.545523:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691476224:12345-192.168.206.1@tcp:33: 00000100:00100000:3.0:1789049933.551547:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049933.551607:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476352 00000100:00100000:3.0:1789049933.551616:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476352 00000100:00100000:3.0:1789049933.551663:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 127 00000100:00100000:3.0:1789049933.551673:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691476352:12345-192.168.206.1@tcp:400: 00000100:00100000:3.0:1789049933.551737:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691476352:12345-192.168.206.1@tcp:400: Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049933.551744:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 127 00000100:00100000:0.0:1789049933.554442:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789049933.554498:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:0.0:1789049933.554513:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875954691475968:12345-192.168.206.1@tcp:8: 00010000:00080000:0.0:1789049933.554545:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1789049933.554574:0:6670:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78a2e 00002000:00100000:0.0:1789049933.554586:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2c118c85-b079-4c51-87ec-099389ee7be3/ffff950605b89000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789049933.554607:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789049933.554922:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789049933.554954:0:6670:0:(import.c:65:import_set_state_nolock()) ffff950605b88800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049933.555027:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691475968:12345-192.168.206.1@tcp:8: Request processed in 521us (10959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049933.555035:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000004:00080000:3.0:1789049933.562315:0:5820:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16731us 00000004:00200000:2.0:1789049933.581241:0:5820:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789049933.581364:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:5577:x1875954691476224:12345-192.168.206.1@tcp:33: Request processed in 35837us (37339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049933.581378:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789049933.893659:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049933.894647:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476480 00000100:00100000:0.0:1789049933.894658:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476480 00000100:00100000:0.0:1789049933.894726:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789049933.894737:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:5617:x1875954691476480:12345-192.168.206.1@tcp:101: 00010000:00010000:0.0:1789049933.894756:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049933.894816:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f71b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895008:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895022:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895037:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049933.895088:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049933.895092:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049933.895109:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895136:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f71b expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895156:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f71b expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049933.895164:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52100) 00010000:00010000:0.0:1789049933.895168:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049933.895171:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330800, rc 0) 00000100:00100000:0.0:1789049933.895294:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:5617:x1875954691476480:12345-192.168.206.1@tcp:101: Request processed in 544us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049933.895302:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00010000:00010000:1.0:1789049933.971472:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049934.475674:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704080256:0@lo:13: 00000100:00100000:1.0:1789049934.475745:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049934.475858:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080256 00000100:00100000:0.0:1789049934.475866:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080256 00000100:00100000:0.0:1789049934.475919:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049934.475929:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704080256:12345-0@lo:13: 00002000:00000024:0.0:1789049934.475952:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049934.476002:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704080256:12345-0@lo:13: Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00080000:3.0:1789049934.476009:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049934.476009:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789049934.476069:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033daa00 x1875954704080256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049934.476090:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704080256:0@lo:13: 00000001:00100000:2.0:1789049934.550527:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00010000:00010000:3.0:1789049934.987489:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049935.910084:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049935.910236:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476608 00000100:00100000:2.0:1789049935.910249:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476608 00000100:00100000:2.0:1789049935.910430:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789049935.910440:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:5669:x1875954691476608:12345-192.168.206.1@tcp:41: 00000004:00000024:2.0:1789049935.910481:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789049935.910552:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:5669:x1875954691476608:12345-192.168.206.1@tcp:41: Request processed in 114us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049935.910560:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00080000:3.0:1789049935.912477:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049935.912754:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049935.912857:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476736 00000100:00100000:0.0:1789049935.912866:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476736 00000100:00100000:0.0:1789049935.912949:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789049935.912959:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2c118c85-b079-4c51-87ec-099389ee7be3+5:5669:x1875954691476736:12345-192.168.206.1@tcp:13: 00002000:00000024:0.0:1789049935.912994:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049935.913057:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2c118c85-b079-4c51-87ec-099389ee7be3+5:5669:x1875954691476736:12345-192.168.206.1@tcp:13: Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049935.913072:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00080000:2.0:1789049935.913246:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049935.914757:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049935.914836:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476864 00000100:00100000:3.0:1789049935.914895:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476864 00000100:00100000:3.0:1789049935.914956:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789049935.914965:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2c118c85-b079-4c51-87ec-099389ee7be3+6:5669:x1875954691476864:12345-192.168.206.1@tcp:13: 00002000:00000024:3.0:1789049935.914994:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049935.915105:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2c118c85-b079-4c51-87ec-099389ee7be3+6:5669:x1875954691476864:12345-192.168.206.1@tcp:13: Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049935.915112:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00080000:2.0:1789049935.915282:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789049936.012442:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049936.524946:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704080640:0@lo:400: 00000100:00100000:3.0:1789049936.525030:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049936.525082:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049936.525089:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704080768:0@lo:400: 00000100:00100000:3.0:1789049936.525113:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049936.525896:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704080512:0@lo:400: 00000100:00100000:1.0:1789049936.525939:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049936.525967:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704081024:0@lo:400: 00000100:00100000:1.0:1789049936.525989:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049936.526021:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789049936.526027:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704080384:0@lo:400: 00000100:00100000:1.0:1789049936.526818:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049936.526859:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704080896:0@lo:400: 00000100:00100000:1.0:1789049936.526893:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049936.526932:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080640 00000100:00100000:1.0:1789049936.526940:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080640 00000100:00100000:1.0:1789049936.526993:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080512 00000100:00100000:1.0:1789049936.526997:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080512 00000100:00100000:1.0:1789049936.527009:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080896 00000100:00100000:1.0:1789049936.527012:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080896 00000100:00100000:1.0:1789049936.527027:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049936.527035:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704080640:12345-0@lo:400: 00000100:00100000:1.0:1789049936.527480:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704080640:12345-0@lo:400: Request processed in 445us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049936.527489:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049936.527507:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049936.527514:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704080512:12345-0@lo:400: 00000100:00100000:1.0:1789049936.527557:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704080512:12345-0@lo:400: Request processed in 44us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049936.527563:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049936.527576:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049936.527582:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704080896:12345-0@lo:400: 00000100:00100000:1.0:1789049936.527609:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704080896:12345-0@lo:400: Request processed in 28us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049936.527615:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049936.527634:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080768 00000100:00100000:1.0:1789049936.527638:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080768 00000100:00100000:1.0:1789049936.527664:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081024 00000100:00100000:1.0:1789049936.527667:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081024 00000100:00100000:1.0:1789049936.527680:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049936.527685:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704080768:12345-0@lo:400: 00000100:00100000:1.0:1789049936.527714:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704080768:12345-0@lo:400: Request processed in 29us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049936.527720:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049936.527921:0:6671:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789049936.527931:0:6671:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789049936.528154:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049936.528161:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704081024:12345-0@lo:400: 00000100:00100000:1.0:1789049936.528195:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704081024:12345-0@lo:400: Request processed in 35us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049936.528394:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704080384 00000100:00100000:2.0:1789049936.528399:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704080384 00000100:00100000:2.0:1789049936.528490:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789049936.528498:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704080384:12345-0@lo:400: 00000100:00100000:1.0:1789049936.528519:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049936.528541:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704080384:12345-0@lo:400: Request processed in 44us (2484us total) trans 0 rc 0/0 00000100:00080000:1.0:1789049936.528542:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049936.528549:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049936.528552:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789049936.528554:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049936.528635:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c95c00 x1875954704080768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049936.528661:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704080768:0@lo:400: 00000100:00100000:1.0:1789049936.528810:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704080640:0@lo:400: 00000100:00100000:1.0:1789049936.528854:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704080384:0@lo:400: 00000100:00100000:1.0:1789049936.528867:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704080896:0@lo:400: 00000100:00100000:1.0:1789049936.528880:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704080512:0@lo:400: 00010000:00080000:1.0:1789049936.528893:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1a5f80 x1875954704081024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049936.528901:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704081024:0@lo:400: 00000100:00100000:1.0:1789049937.039385:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704081152:0@lo:13: 00000100:00100000:1.0:1789049937.039450:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049937.039577:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049937.039624:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081152 00000100:00100000:2.0:1789049937.039631:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081152 00000100:00100000:2.0:1789049937.039677:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049937.039686:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704081152:12345-0@lo:13: 00002000:00000024:2.0:1789049937.039719:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049937.039768:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704081152:12345-0@lo:13: Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049937.039776:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789049937.039852:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720825500 x1875954704081152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049937.039869:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704081152:0@lo:13: 00000001:00100000:3.0:1789049937.585052:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000001:00100000:1.0:1789049937.593101:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00010000:00010000:1.0:1789049938.059465:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049938.108933:0:8291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789049938.641476:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049938.641525:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049938.641557:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049938.641604:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049938.641635:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477248 00000100:00100000:3.0:1789049938.641643:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477248 00000100:00100000:0.0:1789049938.641979:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477376 00000100:00100000:0.0:1789049938.641994:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477376 00000100:00100000:0.0:1789049938.642082:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:0.0:1789049938.642098:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691477376:12345-192.168.206.1@tcp:400: 00000100:00100000:0.0:1789049938.642240:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691477376:12345-192.168.206.1@tcp:400: Request processed in 103us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049938.642250:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789049938.642274:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691477248:12345-192.168.206.1@tcp:400: 00000100:00100000:1.0:1789049938.642316:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477120 00000100:00100000:1.0:1789049938.642322:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477120 00000100:00100000:3.0:1789049938.642333:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691477248:12345-192.168.206.1@tcp:400: Request processed in 64us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049938.642362:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691476992 00000100:00100000:2.0:1789049938.642367:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691476992 00000100:00100000:2.0:1789049938.642398:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00100000:2.0:1789049938.642404:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2347:x1875954691476992:12345-192.168.206.1@tcp:400: 00000100:00100000:2.0:1789049938.642432:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2347:x1875954691476992:12345-192.168.206.1@tcp:400: Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049938.642437:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00080000:2.0:1789049938.642484:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049938.642488:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049938.642938:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789049938.643004:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:1.0:1789049938.643006:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:1.0:1789049938.643013:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691477120:12345-192.168.206.1@tcp:400: 00000100:00080000:2.0:1789049938.643296:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049938.643316:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691477120:12345-192.168.206.1@tcp:400: Request processed in 302us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049938.643405:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00010000:00010000:3.0:1789049939.083965:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049939.595640:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704081280:0@lo:13: 00000100:00100000:1.0:1789049939.595705:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049939.595779:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081280 00000100:00100000:1.0:1789049939.595786:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081280 00000100:00100000:1.0:1789049939.595853:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789049939.595864:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704081280:12345-0@lo:13: 00002000:00000024:1.0:1789049939.595896:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049939.595939:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704081280:12345-0@lo:13: Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049939.595947:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789049939.595967:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789049939.595996:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d3480 x1875954704081280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049939.596015:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704081280:0@lo:13: 00010000:00010000:1.0:1789049940.109527:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049941.143939:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789049941.164151:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa85c2a50 20000000:00000080:1.0:1789049941.164445:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95073c240000 uarg=0000000000000000 20000000:01000000:1.0:1789049941.164530:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789049941.164532:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789049941.164534:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789049941.164538:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789049941.164543:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789049941.164554:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789049941.164557:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789049941.164785:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049941.164788:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049941.165638:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789049941.166063:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789049941.166109:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789049941.166156:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789049941.166181:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789049941.166184:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789049941.167039:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789049941.167594:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789049941.167728:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789049941.167767:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789049941.167780:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789049941.167782:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789049941.168629:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789049941.169072:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789049941.169132:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789049941.169531:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789049941.169549:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789049941.169551:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789049941.170473:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789049941.170851:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789049941.170894:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789049941.170924:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1789049941.170936:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789049941.170953:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.170970:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78939 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.170978:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78963 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.170985:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7898d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.170992:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7899b expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.170999:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789a9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171014:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789c5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171021:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b789ef expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171031:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171038:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171046:0:8439:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171079:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171092:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 9 pid: 5810 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.171106:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081408:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789049941.171912:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.171923:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.171932:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081536:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789049941.172032:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172040:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 18 pid: 5812 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172049:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081664:0@lo:104: 00000100:00100000:3.0:1789049941.172084:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049941.172123:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172130:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 18 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172138:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081792:0@lo:104: 00000100:00100000:3.0:1789049941.172170:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049941.172196:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172223:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 18 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172231:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081920:0@lo:104: 00010000:00010000:3.0:1789049941.172269:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172277:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 18 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172285:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082048:0@lo:104: 00010000:00010000:3.0:1789049941.172318:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172326:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 18 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172333:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082176:0@lo:104: 00010000:00010000:3.0:1789049941.172356:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172364:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 18 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172370:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082304:0@lo:104: 00010000:00010000:3.0:1789049941.172564:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.172572:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 18 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.172581:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082432:0@lo:104: 00000100:00100000:3.0:1789049941.172601:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049941.173305:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789049941.173328:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.173353:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.173363:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.173372:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049941.173487:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081664 00000100:00100000:2.0:1789049941.173495:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081664 00000100:00100000:2.0:1789049941.173530:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081792 00000100:00100000:2.0:1789049941.173533:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081792 00000100:00100000:2.0:1789049941.173543:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704081920 00000100:00100000:2.0:1789049941.173554:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704081920 00000100:00100000:2.0:1789049941.173566:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082048 00000100:00100000:2.0:1789049941.173568:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082048 00000100:00100000:2.0:1789049941.173576:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082176 00000100:00100000:2.0:1789049941.173578:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082176 00000100:00100000:2.0:1789049941.173586:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082304 00000100:00100000:2.0:1789049941.173588:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082304 00000100:00100000:2.0:1789049941.173601:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049941.173609:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+8:8439:x1875954704081664:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173623:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173691:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049941.173697:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+8:8439:x1875954704081664:12345-0@lo:104: Request processed in 89us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.173704:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049941.173719:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049941.173724:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702c45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+7:8439:x1875954704081792:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173732:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173760:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049941.173765:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702c45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+7:8439:x1875954704081792:12345-0@lo:104: Request processed in 41us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.173770:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049941.173796:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049941.173801:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:8439:x1875954704081920:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173807:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173840:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789049941.173844:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+6:8439:x1875954704081920:12345-0@lo:104: Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.173850:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049941.173860:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049941.173865:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:8439:x1875954704082048:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173871:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173890:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789049941.173894:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:8439:x1875954704082048:12345-0@lo:104: Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.173899:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049941.173907:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049941.173912:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:8439:x1875954704082176:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173917:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173937:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789049941.173940:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:8439:x1875954704082176:12345-0@lo:104: Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.173945:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049941.173955:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049941.173960:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:8439:x1875954704082304:12345-0@lo:104: 00010000:00010000:2.0:1789049941.173966:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.173994:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789049941.173998:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:8439:x1875954704082304:12345-0@lo:104: Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.174003:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789049941.174019:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789049941.174025:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174033:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.174037:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174045:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.174052:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.174058:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.174085:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174091:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.174107:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174115:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703330600/0x9df728c939b789ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174136:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789049941.174139:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174145:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.174148:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174155:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.174161:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.174167:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.174178:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174184:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.174189:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174195:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b789c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174225:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789049941.174228:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174254:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.174256:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174262:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.174267:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.174271:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.174295:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174301:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.174312:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174317:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031000/0x9df728c939b789a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174325:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789049941.174328:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174332:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.174335:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174350:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.174355:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.174359:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.174370:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.174375:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.174379:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.174728:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.174752:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082432 00000100:00100000:1.0:1789049941.174758:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082432 00000100:00100000:1.0:1789049941.174800:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049941.174807:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:8439:x1875954704082432:12345-0@lo:104: 00010000:00010000:1.0:1789049941.174817:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.174857:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789049941.174862:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:8439:x1875954704082432:12345-0@lo:104: Request processed in 57us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.174868:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789049941.174890:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789049941.174913:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704082688:0@lo:103: 00000100:00100000:1.0:1789049941.174943:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.174973:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049941.174979:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704082560:0@lo:103: 00000100:00100000:1.0:1789049941.175010:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.175040:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704082816:0@lo:103: 00000100:00100000:1.0:1789049941.175060:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.175076:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049941.175081:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704082944:0@lo:103: 00000100:00100000:1.0:1789049941.175098:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049941.175117:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082688 00000100:00100000:1.0:1789049941.175121:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082688 00010000:00010000:1.0:1789049941.175137:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 19 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.175150:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082560 00000100:00100000:1.0:1789049941.175153:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082560 00010000:00010000:1.0:1789049941.175173:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 20 pid: 5812 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.175185:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082816 00000100:00100000:1.0:1789049941.175187:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082816 00010000:00010000:1.0:1789049941.175212:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 21 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.175224:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704082944 00000100:00100000:1.0:1789049941.175227:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704082944 00010000:00010000:1.0:1789049941.175237:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 22 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.175261:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049941.175266:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+22:3285:x1875954704082688:12345-0@lo:103: 00010000:00010000:1.0:1789049941.175276:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.175280:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 22 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.175295:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 22 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.175311:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.175335:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+22:3285:x1875954704082688:12345-0@lo:103: Request processed in 69us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.175341:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049941.175353:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049941.175359:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3285:x1875954704082560:12345-0@lo:103: 00010000:00010000:1.0:1789049941.175366:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.175370:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 21 pid: 5812 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.175378:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 21 pid: 5812 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175606:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031200/0x9df728c939b7899b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b789a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175618:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049941.175622:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175628:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.175631:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175640:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.175874:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.175887:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.175916:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175922:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.175930:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175937:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b78963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7896a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175946:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049941.175949:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175956:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049941.175959:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175965:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049941.175971:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049941.175975:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049941.175986:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.175992:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049941.176003:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.176008:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e400/0x9df728c939b78939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78940 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.176018:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049941.176020:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049941.176021:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049941.176032:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704083072:0@lo:103: 00000100:00100000:2.0:1789049941.176064:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049941.176087:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049941.176093:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704083200:0@lo:103: 00000100:00100000:2.0:1789049941.176110:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049941.176178:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.176231:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3285:x1875954704082560:12345-0@lo:103: Request processed in 871us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.176248:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049941.176264:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083072 00000100:00100000:1.0:1789049941.176268:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083072 00010000:00010000:1.0:1789049941.176283:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 21 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.176296:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083200 00000100:00100000:1.0:1789049941.176298:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083200 00010000:00010000:1.0:1789049941.176308:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 22 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049941.176333:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049941.176340:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+22:3282:x1875954704082816:12345-0@lo:103: 00010000:00010000:1.0:1789049941.176348:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.176353:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 22 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176361:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 22 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176370:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.176686:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+22:3282:x1875954704082816:12345-0@lo:103: Request processed in 346us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.176694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049941.176709:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049941.176717:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3282:x1875954704082944:12345-0@lo:103: 00010000:00010000:1.0:1789049941.176725:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.176729:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 21 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176737:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 21 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176746:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.176765:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+21:3282:x1875954704082944:12345-0@lo:103: Request processed in 50us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.176770:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049941.176782:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049941.176794:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+20:3284:x1875954704083072:12345-0@lo:103: 00010000:00010000:1.0:1789049941.176801:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.176805:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 20 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176812:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 20 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176821:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.176846:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+20:3284:x1875954704083072:12345-0@lo:103: Request processed in 53us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.176852:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049941.176862:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789049941.176867:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704083200:12345-0@lo:103: 00010000:00010000:1.0:1789049941.176873:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049941.176877:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 19 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176884:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 19 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049941.176892:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049941.176909:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704083200:12345-0@lo:103: Request processed in 42us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049941.176914:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789049941.176947:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704082560:0@lo:103: 00000100:00100000:1.0:1789049941.176958:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704082688:0@lo:103: 00000100:00100000:1.0:1789049941.176985:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704083200:0@lo:103: 00000100:00100000:1.0:1789049941.176999:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704083072:0@lo:103: 00000100:00100000:2.0:1789049941.177289:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704082944:0@lo:103: 00000100:00100000:2.0:1789049941.177297:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704082816:0@lo:103: 00010000:00010000:3.0:1789049941.177585:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd25200/0x9df728c939b789f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b789ef expref: 18 pid: 5812 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177597:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081664:0@lo:104: 00010000:00010000:3.0:1789049941.177606:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030600/0x9df728c939b789cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b789c5 expref: 17 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177613:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081792:0@lo:104: 00010000:00010000:3.0:1789049941.177632:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0e800/0x9df728c939b789b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b789a9 expref: 16 pid: 5811 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177641:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081920:0@lo:104: 00010000:00010000:3.0:1789049941.177649:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031600/0x9df728c939b789a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7899b expref: 15 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177719:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082048:0@lo:104: 00000100:00100000:3.0:1789049941.177731:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082176:0@lo:104: 00010000:00010000:3.0:1789049941.177740:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd25400/0x9df728c939b7896a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78963 expref: 14 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177748:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082304:0@lo:104: 00010000:00010000:3.0:1789049941.177758:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030200/0x9df728c939b78940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78939 expref: 13 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.177765:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704082432:0@lo:104: 00000100:00100000:0.0:1789049941.178125:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049941.178147:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477504 00000100:00100000:0.0:1789049941.178152:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477504 00010000:00010000:0.0:1789049941.178192:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 10 pid: 5810 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049941.178256:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:0.0:1789049941.178265:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691477504:12345-192.168.206.1@tcp:103: 00010000:00010000:0.0:1789049941.178275:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049941.178280:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 10 pid: 5810 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.178302:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 10 pid: 5810 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.178318:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049941.178360:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691477504:12345-192.168.206.1@tcp:103: Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049941.178367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00010000:00010000:2.0:1789049941.178675:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701489c00/0x9df728c939b78a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6c0 expref: 9 pid: 5810 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049941.178687:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081408:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789049941.178901:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049941.178903:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049941.178905:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049941.178931:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.178939:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789049941.178944:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.178951:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049941.178957:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049941.178963:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049941.178997:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179004:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049941.179026:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179033:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700030400/0x9df728c939b7898d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78994 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179053:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049941.179054:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049941.179056:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049941.179063:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049941.179075:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704083328:0@lo:103: 00000100:00100000:0.0:1789049941.179111:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049941.179141:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083328 00000100:00100000:0.0:1789049941.179146:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083328 00010000:00010000:0.0:1789049941.179602:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 13 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049941.179635:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049941.179645:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:3283:x1875954704083328:12345-0@lo:103: 00010000:00010000:0.0:1789049941.179748:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049941.179755:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 13 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179765:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 13 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179776:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0e400/0x9df728c939b78994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7898d expref: 13 pid: 5810 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049941.179788:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049941.179863:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:3283:x1875954704083328:12345-0@lo:103: Request processed in 220us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049941.179870:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049941.180094:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704083328:0@lo:103: 00000100:00100000:2.0:1789049941.184029:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875954704081536:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789049941.184075:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049941.185151:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.185565:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477632 00000100:00100000:2.0:1789049941.185574:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477632 00010000:00010000:2.0:1789049941.185614:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049941.185762:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789049941.185773:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:2347:x1875954691477632:12345-192.168.206.1@tcp:103: 00010000:00010000:2.0:1789049941.185788:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049941.185794:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185807:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185833:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330400/0x9df728c939b78a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6b9 expref: 9 pid: 5811 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185848:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185856:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185871:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185878:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185885:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185891:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185903:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789049941.185908:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185916:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185931:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.185940:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049941.185995:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:2347:x1875954691477632:12345-192.168.206.1@tcp:103: Request processed in 224us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.186003:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00010000:00010000:3.0:1789049941.187067:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.187079:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049941.187087:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701488e00/0x9df728c939b78a43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049941.650349:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049941.650520:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704083584:0@lo:400: 00000100:00100000:0.0:1789049941.650554:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704083712:0@lo:400: 00000100:00100000:2.0:1789049941.650584:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049941.650584:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049941.650650:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083712 00000100:00100000:2.0:1789049941.650657:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083712 00000100:00100000:3.0:1789049941.650699:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704083840:0@lo:400: 00000100:00100000:2.0:1789049941.650709:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049941.650718:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704083712:12345-0@lo:400: 00000100:00100000:3.0:1789049941.650727:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049941.650752:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704083456:0@lo:400: 00000100:00100000:2.0:1789049941.650760:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704083712:12345-0@lo:400: Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.650767:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789049941.650769:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049941.650797:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083584 00000100:00100000:2.0:1789049941.650800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083840 00000100:00100000:3.0:1789049941.650801:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083584 00000100:00100000:2.0:1789049941.650803:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083840 00000100:00100000:2.0:1789049941.650826:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083456 00000100:00100000:2.0:1789049941.650828:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083456 00000100:00100000:3.0:1789049941.650829:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789049941.650836:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704083840:12345-0@lo:400: 00000100:00100000:2.0:1789049941.650841:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049941.650859:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704083584:12345-0@lo:400: 00000100:00100000:3.0:1789049941.650869:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704083840:12345-0@lo:400: Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049941.650875:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789049941.650887:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049941.650889:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704083584:12345-0@lo:400: Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049941.650892:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704083456:12345-0@lo:400: 00000100:00100000:2.0:1789049941.650894:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789049941.650910:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049941.650914:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049941.650917:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704083456:12345-0@lo:400: Request processed in 25us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049941.650922:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049941.650944:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704083840:0@lo:400: 00000100:00100000:2.0:1789049941.650944:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704083584:0@lo:400: 00000100:00100000:3.0:1789049941.650954:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704083456:0@lo:400: 00000100:00100000:3.0:1789049941.651161:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:0.0:1789049941.651297:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c97480 x1875954704083712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049941.651308:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704083712:0@lo:400: 00000100:00100000:2.0:1789049941.651769:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704083968:0@lo:400: 00000100:00100000:2.0:1789049941.651810:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049941.651908:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704083968 00000100:00100000:3.0:1789049941.651914:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704083968 00000100:00100000:3.0:1789049941.651992:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049941.652000:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704083968:12345-0@lo:400: 00000100:00100000:3.0:1789049941.652059:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704083968:12345-0@lo:400: Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049941.652075:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789049941.652154:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c94000 x1875954704083968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049941.652166:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704083968:0@lo:400: 00000100:00080000:2.0:1789049941.652464:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049941.899542:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.899644:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477760 00000100:00100000:2.0:1789049941.899655:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477760 00000100:00100000:2.0:1789049941.899754:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 130 00000100:00100000:2.0:1789049941.899765:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:5591:x1875954691477760:12345-192.168.206.1@tcp:101: 00010000:00010000:2.0:1789049941.899780:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049941.899799:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f400/0x9df728c939b78a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f722 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.899825:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f400/0x9df728c939b78a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f722 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.899837:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f400/0x9df728c939b78a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f722 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.899845:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f400, rc 0) 00000100:00100000:2.0:1789049941.899902:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691477760:12345-192.168.206.1@tcp:101: Request processed in 139us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.899909:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 130 00000100:00100000:1.0:1789049941.904015:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.904104:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691477888 00000100:00100000:2.0:1789049941.904112:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691477888 00000100:00100000:2.0:1789049941.904244:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 131 00000100:00100000:2.0:1789049941.904256:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691477888:12345-192.168.206.1@tcp:501: 00000100:00100000:2.0:1789049941.904543:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691477888:12345-192.168.206.1@tcp:501: Request processed in 289us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.904551:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 131 00000100:00100000:0.0:1789049941.910639:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.911338:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478016 00000100:00100000:2.0:1789049941.911419:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478016 00000100:00100000:2.0:1789049941.911548:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 132 00000100:00100000:2.0:1789049941.911560:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691478016:12345-192.168.206.1@tcp:503: 00000100:00100000:2.0:1789049941.911760:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691478016:12345-192.168.206.1@tcp:503: Request processed in 202us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.911768:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 132 00000100:00100000:1.0:1789049941.921489:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.924750:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478144 00000100:00100000:2.0:1789049941.924765:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478144 00000100:00100000:2.0:1789049941.924839:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00100000:2.0:1789049941.924849:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:6057:x1875954691478144:12345-192.168.206.1@tcp:502: 00000100:00100000:2.0:1789049941.925118:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:6057:x1875954691478144:12345-192.168.206.1@tcp:502: Request processed in 270us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.925126:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00100000:1.0:1789049941.927618:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.927801:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478272 00000100:00100000:2.0:1789049941.927810:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478272 00000100:00100000:2.0:1789049941.927868:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 134 00000100:00100000:2.0:1789049941.927878:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:6057:x1875954691478272:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049941.928141:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:6057:x1875954691478272:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 263us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.928157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 134 00000100:00100000:0.0:1789049941.932322:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049941.932755:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478400 00000100:00100000:2.0:1789049941.932765:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478400 00000100:00100000:2.0:1789049941.932998:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 135 00000100:00100000:2.0:1789049941.933008:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691478400:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049941.933023:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049941.933040:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f000/0x9df728c939b78a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f729 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.933067:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f000/0x9df728c939b78a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f729 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.933079:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f000/0x9df728c939b78a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f729 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049941.933087:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f000, rc 0) 00000100:00100000:2.0:1789049941.933191:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478400:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 183us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049941.933229:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 135 00000100:00100000:1.0:1789049941.936138:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049941.936436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478528 00000100:00100000:3.0:1789049941.936446:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478528 00000100:00100000:3.0:1789049941.936503:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 136 00000100:00100000:3.0:1789049941.936514:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478528:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049941.936773:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478528:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 260us (641us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049941.937135:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 136 00000100:00100000:1.0:1789049942.155574:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789049942.155585:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049942.155599:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704084096:0@lo:13: 00000100:00100000:1.0:1789049942.155666:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049942.155797:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084096 00000100:00100000:2.0:1789049942.155816:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084096 00000100:00100000:2.0:1789049942.155869:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049942.155878:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704084096:12345-0@lo:13: 00002000:00000024:2.0:1789049942.155911:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049942.155965:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704084096:12345-0@lo:13: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049942.155988:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789049942.156132:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17c000 x1875954704084096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049942.156151:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704084096:0@lo:13: 10000000:01000000:2.0:1789049942.987277:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789049942.987284:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95073d0e4000 from 39 10000000:01000000:2.0:1789049942.987290:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049942.987337:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.987348:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.987360:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049942.987382:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084224:0@lo:101: 00000100:00100000:2.0:1789049942.987452:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049942.987509:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.987647:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084224 00000100:00100000:0.0:1789049942.987655:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084224 00000100:00100000:0.0:1789049942.987708:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789049942.987717:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+12:5815:x1875954704084224:12345-0@lo:101: 00010000:00010000:0.0:1789049942.987730:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049942.987744:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330200/0x9df728c939b78a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a58 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.987764:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330200/0x9df728c939b78a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a58 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.987774:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330200/0x9df728c939b78a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a58 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.987782:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330200, rc 0) 00000100:00100000:0.0:1789049942.987835:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084224:12345-0@lo:101: Request processed in 119us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.987856:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789049942.988043:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084224:0@lo:101: 00010000:00010000:2.0:1789049942.988057:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.988067:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049942.988117:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084352:0@lo:501: 00000100:00100000:2.0:1789049942.988144:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049942.988170:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.988228:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084352 00000100:00100000:0.0:1789049942.988242:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084352 00000100:00100000:0.0:1789049942.988267:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789049942.988274:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084352:12345-0@lo:501: 00000100:00100000:0.0:1789049942.988502:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084352:12345-0@lo:501: Request processed in 228us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.988509:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789049942.988704:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084352:0@lo:501: 00000100:00100000:1.0:1789049942.988735:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084480:0@lo:503: 00000100:00100000:1.0:1789049942.988774:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.989248:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706449c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049942.989430:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084480 00000100:00100000:3.0:1789049942.989437:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084480 00000100:00100000:3.0:1789049942.989475:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789049942.989484:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084480:12345-0@lo:503: 00000100:00100000:3.0:1789049942.989666:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084480:12345-0@lo:503: Request processed in 183us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049942.989673:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789049942.989917:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084480:0@lo:503: 00000100:00100000:3.0:1789049942.991719:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8476:1875954704084608:0@lo:502: 00000100:00100000:3.0:1789049942.991791:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049942.991933:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.992228:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084608 00000100:00100000:0.0:1789049942.992245:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084608 00000100:00100000:1.0:1789049942.992362:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789049942.992372:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:8476:x1875954704084608:12345-0@lo:502: 00000100:00100000:1.0:1789049942.992629:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:8476:x1875954704084608:12345-0@lo:502: Request processed in 258us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049942.992636:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789049942.992867:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8476:1875954704084608:0@lo:502: 00000100:00100000:3.0:1789049942.992915:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8476:1875954704084736:0@lo:502: 00000100:00100000:3.0:1789049942.992951:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049942.992981:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049942.993112:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084736 00000100:00100000:1.0:1789049942.993117:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084736 00000100:00100000:1.0:1789049942.993155:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789049942.993162:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:8476:x1875954704084736:12345-0@lo:502: 00000100:00100000:1.0:1789049942.993349:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:8476:x1875954704084736:12345-0@lo:502: Request processed in 187us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049942.993356:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789049942.993766:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8476:1875954704084736:0@lo:502: 00000040:00080000:3.0:1789049942.993794:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789049942.994011:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789049942.994034:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789049942.994043:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049942.994053:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049942.994062:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789049942.994064:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789049942.994067:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789049942.994092:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049942.994099:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049942.994107:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049942.994120:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084864:0@lo:101: 00000100:00100000:1.0:1789049942.994152:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.994183:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507064493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049942.994283:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084864 00000100:00100000:2.0:1789049942.994288:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084864 00000100:00100000:2.0:1789049942.994324:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789049942.994331:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+13:5815:x1875954704084864:12345-0@lo:101: 00010000:00010000:2.0:1789049942.994341:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049942.994353:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0e800/0x9df728c939b78a6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a66 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.994373:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0e800/0x9df728c939b78a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a66 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.994383:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0e800/0x9df728c939b78a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a66 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.994391:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0e800, rc 0) 00000100:00100000:2.0:1789049942.994426:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704084864:12345-0@lo:101: Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049942.994432:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789049942.994520:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084864:0@lo:101: 00010000:00010000:1.0:1789049942.994554:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049942.994561:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049942.994601:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084992:0@lo:501: 00000100:00100000:1.0:1789049942.994625:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.994646:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507064493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.994769:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704084992 00000100:00100000:0.0:1789049942.994775:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704084992 00000100:00100000:0.0:1789049942.994815:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789049942.994824:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704084992:12345-0@lo:501: 00000100:00100000:0.0:1789049942.995044:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704084992:12345-0@lo:501: Request processed in 221us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.995050:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789049942.995186:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704084992:0@lo:501: 00000100:00100000:1.0:1789049942.995246:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085120:0@lo:503: 00000100:00100000:1.0:1789049942.995281:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.995303:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507064493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049942.995316:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085120 00000100:00100000:1.0:1789049942.995319:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085120 00000100:00100000:1.0:1789049942.995337:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789049942.995344:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704085120:12345-0@lo:503: 00000100:00100000:1.0:1789049942.995474:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704085120:12345-0@lo:503: Request processed in 130us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049942.995481:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789049942.995517:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085120:0@lo:503: 00000100:00100000:1.0:1789049942.995743:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8477:1875954704085248:0@lo:502: 00000100:00100000:1.0:1789049942.995776:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.995795:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085248 00000100:00100000:1.0:1789049942.995799:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085248 00000100:00100000:1.0:1789049942.996002:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789049942.996015:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:8477:x1875954704085248:12345-0@lo:502: 00000100:00100000:1.0:1789049942.996141:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:8477:x1875954704085248:12345-0@lo:502: Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049942.996148:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789049942.996182:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049942.996196:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8477:1875954704085248:0@lo:502: 00000020:01000000:1.0:1789049942.996250:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049942.996258:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049942.996261:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789049942.996266:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789049942.996287:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8477:1875954704085376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049942.996320:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.996340:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706449b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.996412:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085376 00000100:00100000:0.0:1789049942.996416:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085376 00000100:00100000:0.0:1789049942.996436:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789049942.996442:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:8477:x1875954704085376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049942.996644:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:8477:x1875954704085376:12345-0@lo:502:llog_process_th.0 Request processed in 201us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.996651:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789049942.996909:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8477:1875954704085376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049942.996931:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049942.996936:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049942.996938:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789049942.996942:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789049942.997706:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789049942.997734:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789049942.997744:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.997754:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049942.997763:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789049942.997765:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95071009a800 from 39 10000000:01000000:2.0:1789049942.997768:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049942.997795:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.997825:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049942.997835:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049942.997852:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049942.997891:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049942.997915:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.998055:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085504 00000100:00100000:0.0:1789049942.998060:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085504 00000100:00100000:0.0:1789049942.998102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789049942.998118:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:5815:x1875954704085504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049942.998129:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049942.998140:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b78a7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a74 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.998160:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b78a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a74 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.998171:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331c00/0x9df728c939b78a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a74 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049942.998178:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:0.0:1789049942.998258:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704085504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.998265:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789049942.998353:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049942.998368:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049942.998376:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049942.998423:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049942.998450:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.998481:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049942.998549:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085632 00000100:00100000:3.0:1789049942.998554:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085632 00000100:00100000:3.0:1789049942.998587:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789049942.998594:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704085632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049942.999018:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704085632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049942.999024:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789049942.999092:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049942.999121:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049942.999158:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049942.999181:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049942.999277:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085760 00000100:00100000:0.0:1789049942.999282:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085760 00000100:00100000:0.0:1789049942.999308:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789049942.999316:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704085760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049942.999459:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704085760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049942.999466:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789049942.999541:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704085760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049943.000085:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8478:1875954704085888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049943.000126:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049943.000155:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049943.000226:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704085888 00000100:00100000:0.0:1789049943.000240:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704085888 00000100:00100000:0.0:1789049943.000271:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049943.000279:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:8478:x1875954704085888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049943.000453:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:8478:x1875954704085888:12345-0@lo:502:llog_process_th.0 Request processed in 174us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.000466:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789049943.000674:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8478:1875954704085888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049943.000716:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8478:1875954704086016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049943.000749:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049943.000775:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049943.000820:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086016 00000100:00100000:0.0:1789049943.000824:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086016 00000100:00100000:0.0:1789049943.000843:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789049943.000850:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:8478:x1875954704086016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049943.000986:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:8478:x1875954704086016:12345-0@lo:502:llog_process_th.0 Request processed in 137us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.000993:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789049943.001119:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8478:1875954704086016:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789049943.001137:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789049943.001493:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789049943.001511:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049943.001521:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.001655:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049943.001664:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789049943.001667:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789049943.001669:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049943.001695:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.001703:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.001712:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.001727:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049943.001770:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.001801:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.001917:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086144 00000100:00100000:2.0:1789049943.001923:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086144 00000100:00100000:2.0:1789049943.001959:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789049943.001968:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:5815:x1875954704086144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049943.001977:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049943.001989:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0ec00/0x9df728c939b78a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a82 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.002009:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0ec00/0x9df728c939b78a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a82 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.002019:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0ec00/0x9df728c939b78a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a82 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.002027:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0ec00, rc 0) 00000100:00100000:2.0:1789049943.002067:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.002074:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789049943.002367:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049943.002381:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.002389:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.002432:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049943.002458:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.002485:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.002773:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086272 00000100:00100000:2.0:1789049943.002778:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086272 00000100:00100000:2.0:1789049943.002882:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789049943.002890:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049943.003185:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.003249:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789049943.006052:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049943.006116:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049943.006225:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049943.006272:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.006406:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086400 00000100:00100000:3.0:1789049943.006413:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086400 00000100:00100000:3.0:1789049943.006465:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789049943.006474:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.006743:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.006750:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789049943.006949:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049943.007504:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8479:1875954704086528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049943.007628:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049943.007664:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049943.007720:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086528 00000100:00100000:0.0:1789049943.007726:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086528 00000100:00100000:0.0:1789049943.007765:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789049943.007774:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:8479:x1875954704086528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049943.008058:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:8479:x1875954704086528:12345-0@lo:502:llog_process_th.0 Request processed in 284us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.008065:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789049943.008153:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8479:1875954704086528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049943.008178:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049943.008186:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049943.008415:0:8479:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789049943.008425:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789049943.008449:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8479:1875954704086656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049943.008487:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049943.008638:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d10300 going to sleep for 11 seconds 00000100:00100000:1.0:1789049943.009826:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086656 00000100:00100000:1.0:1789049943.009836:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086656 00000100:00100000:1.0:1789049943.009887:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789049943.009908:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:8479:x1875954704086656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049943.010136:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:8479:x1875954704086656:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049943.010144:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789049943.010368:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8479:1875954704086656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049943.010399:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049943.010405:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049943.010407:0:8479:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789049943.010412:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789049943.010779:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789049943.010799:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789049943.010815:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049943.010827:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049943.010836:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789049943.010839:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950707961800 from 39 10000000:01000000:1.0:1789049943.010841:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049943.010868:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049943.010876:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049943.010884:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049943.010903:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049943.010940:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049943.010975:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.011064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086784 00000100:00100000:2.0:1789049943.011069:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086784 00000100:00100000:2.0:1789049943.011105:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789049943.011112:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704086784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049943.011144:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049943.011157:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f600/0x9df728c939b78a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a90 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.011176:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f600/0x9df728c939b78a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a90 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.011220:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f600/0x9df728c939b78a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a90 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.011239:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f600, rc 0) 00000100:00100000:2.0:1789049943.011278:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704086784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.011284:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789049943.011412:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049943.011426:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.011435:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049943.011479:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.011505:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.011537:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.011927:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704086912 00000100:00100000:2.0:1789049943.011932:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704086912 00000100:00100000:2.0:1789049943.011962:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789049943.011969:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704086912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049943.012247:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704086912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.012254:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789049943.012390:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704086912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.012420:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.012464:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.012487:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.012500:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087040 00000100:00100000:3.0:1789049943.012504:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087040 00000100:00100000:3.0:1789049943.012525:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789049943.012543:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704087040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.012673:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704087040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.012680:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789049943.012717:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.012888:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8480:1875954704087168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049943.012921:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.012939:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087168 00000100:00100000:3.0:1789049943.012943:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087168 00000100:00100000:3.0:1789049943.012960:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789049943.012966:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8480:x1875954704087168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049943.013104:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8480:x1875954704087168:12345-0@lo:502:llog_process_th.0 Request processed in 138us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.013111:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789049943.013138:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.013150:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8480:1875954704087168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049943.013184:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8480:1875954704087296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049943.013256:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.013276:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087296 00000100:00100000:3.0:1789049943.013285:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087296 00000100:00100000:3.0:1789049943.013302:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789049943.013309:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8480:x1875954704087296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049943.013427:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8480:x1875954704087296:12345-0@lo:502:llog_process_th.0 Request processed in 119us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.013433:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789049943.013459:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.013471:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8480:1875954704087296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789049943.013490:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789049943.013536:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789049943.013551:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049943.013558:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013568:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049943.013575:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789049943.013578:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789049943.013580:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049943.013599:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013606:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013615:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049943.013639:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.013664:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.013678:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.013689:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087424 00000100:00100000:3.0:1789049943.013693:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087424 00000100:00100000:3.0:1789049943.013709:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789049943.013714:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704087424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049943.013722:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049943.013733:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701488000/0x9df728c939b78aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78a9e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013752:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701488000/0x9df728c939b78aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78a9e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013761:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701488000/0x9df728c939b78aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78a9e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013768:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488000, rc 0) 00000100:00100000:3.0:1789049943.013797:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704087424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.013803:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789049943.013830:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049943.013842:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.013850:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049943.013893:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.013917:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.013931:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.013942:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087552 00000100:00100000:3.0:1789049943.013945:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087552 00000100:00100000:3.0:1789049943.013961:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789049943.013966:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704087552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.014140:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704087552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.014147:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789049943.014173:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.014221:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.014267:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.014281:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.014292:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087680 00000100:00100000:3.0:1789049943.014295:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087680 00000100:00100000:3.0:1789049943.014310:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789049943.014315:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704087680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.014436:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704087680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.014442:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789049943.014477:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704087680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049943.022482:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8481:1875954704087808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049943.022589:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.022633:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.022756:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087808 00000100:00100000:2.0:1789049943.022764:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087808 00000100:00100000:2.0:1789049943.022821:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789049943.022830:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8481:x1875954704087808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049943.023058:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8481:x1875954704087808:12345-0@lo:502:llog_process_th.0 Request processed in 229us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.023076:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789049943.023344:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8481:1875954704087808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049943.023374:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049943.023383:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049943.023386:0:8481:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789049943.023397:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789049943.023421:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8481:1875954704087936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049943.023458:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.024074:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049943.025121:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704087936 00000100:00100000:2.0:1789049943.025131:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704087936 00000100:00100000:2.0:1789049943.025308:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789049943.025319:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8481:x1875954704087936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049943.025701:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8481:x1875954704087936:12345-0@lo:502:llog_process_th.0 Request processed in 384us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.025709:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789049943.027980:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8481:1875954704087936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049943.028031:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049943.028041:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049943.028044:0:8481:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789049943.028048:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789049943.028375:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789049943.028404:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789049943.028414:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.028425:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049943.028436:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789049943.028438:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff950706403380 from 1 10000000:01000000:3.0:1789049943.028441:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789049943.028472:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.028480:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.028488:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049943.028509:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704088064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.028577:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.028621:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789049943.028730:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088064 00000100:00100000:0.0:1789049943.028737:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088064 00000100:00100000:0.0:1789049943.028782:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789049943.028792:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704088064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049943.028811:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049943.028825:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331a00/0x9df728c939b78ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78aac expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.028845:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331a00/0x9df728c939b78ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78aac expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.028855:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331a00/0x9df728c939b78ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78aac expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.028863:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331a00, rc 0) 00000100:00100000:0.0:1789049943.028900:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704088064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.028906:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789049943.029124:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704088064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049943.029138:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.029147:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049943.029225:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704088192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.029272:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.029289:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.029303:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088192 00000100:00100000:3.0:1789049943.029307:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088192 00000100:00100000:3.0:1789049943.029332:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789049943.029338:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704088192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.029956:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704088192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 615us (681us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049943.029964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789049943.030035:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704088192:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789049943.030065:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789049943.030071:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.030078:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789049943.149911:0:8500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3f23c0d0 20000000:00000080:2.0:1789049943.149928:0:8500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950605752800 uarg=0000000000000000 20000000:01000000:2.0:1789049943.149966:0:8500:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789049943.149971:0:8500:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789049943.149975:0:8500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789049943.150950:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789049943.151108:0:8500:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789049943.155733:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789049943.155793:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789049943.155925:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789049943.155945:0:8500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789049943.155964:0:8500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.155987:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78828 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.155995:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156002:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78955 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156011:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156019:0:8500:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156055:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156069:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 9 pid: 5811 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.156082:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088320:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789049943.156183:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156192:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.156246:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088448:0@lo:104: 00000100:00100000:2.0:1789049943.156291:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049943.156403:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.156412:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.156421:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088576:0@lo:104: 00000100:00100000:2.0:1789049943.156447:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049943.158861:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.158879:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 18 pid: 5812 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.158893:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088704:0@lo:104: 00000100:00100000:2.0:1789049943.158931:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049943.160567:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049943.160600:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049943.160627:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088448 00000100:00100000:3.0:1789049943.160634:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088448 00000100:00100000:3.0:1789049943.160669:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088576 00000100:00100000:3.0:1789049943.160671:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088576 00000100:00100000:3.0:1789049943.160679:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088704 00000100:00100000:3.0:1789049943.160681:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088704 00000100:00100000:3.0:1789049943.160692:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049943.160699:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:8500:x1875954704088448:12345-0@lo:104: 00010000:00010000:3.0:1789049943.160713:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.160766:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049943.160771:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+5:8500:x1875954704088448:12345-0@lo:104: Request processed in 73us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.160777:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049943.160791:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049943.160796:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c243450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:8500:x1875954704088576:12345-0@lo:104: 00000100:00100000:2.0:1789049943.160927:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049943.160936:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:8500:x1875954704088704:12345-0@lo:104: 00010000:00010000:2.0:1789049943.160944:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.160979:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049943.160984:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:8500:x1875954704088704:12345-0@lo:104: Request processed in 50us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.160989:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049943.161026:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088448:0@lo:104: 00000100:00100000:2.0:1789049943.161034:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088704:0@lo:104: 00010000:00010000:3.0:1789049943.161084:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161126:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789049943.161131:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c243450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:8500:x1875954704088576:12345-0@lo:104: Request processed in 335us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.161137:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789049943.161170:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789049943.161176:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161183:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25e00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049943.161187:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.161418:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088576:0@lo:104: 00010000:00010000:3.0:1789049943.161514:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049943.161535:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049943.161541:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789049943.161601:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161608:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049943.161624:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161631:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bd25e00/0x9df728c939b78955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7895c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161648:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049943.161651:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161657:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fa00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789049943.161660:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.161667:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049943.161673:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049943.161678:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789049943.161766:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789049943.162011:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:0.0:1789049943.162032:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049943.162043:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162050:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789049943.162052:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162058:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049943.162064:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049943.162069:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049943.162087:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162092:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049943.162107:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162113:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700030000/0x9df728c939b7888a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78891 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162123:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049943.162125:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049943.162126:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049943.162137:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704088832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049943.162169:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.162240:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478656 00000100:00100000:0.0:1789049943.162246:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478656 00010000:00010000:0.0:1789049943.162276:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 10 pid: 5811 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.162297:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088832 00000100:00100000:0.0:1789049943.162300:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088832 00010000:00010000:0.0:1789049943.162312:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 19 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.162324:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:0.0:1789049943.162331:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691478656:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049943.162341:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049943.162346:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 10 pid: 5811 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162357:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 10 pid: 5811 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162373:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049943.162410:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691478656:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 79us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.162416:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:0.0:1789049943.162430:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049943.162437:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704088832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049943.162445:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049943.162448:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 19 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162456:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 19 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162475:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031800/0x9df728c939b7895c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78955 expref: 19 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.162484:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049943.162512:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3285:x1875954704088832:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.162517:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049943.163020:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704088960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049943.163050:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049943.163083:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704088960 00000100:00100000:0.0:1789049943.163087:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704088960 00010000:00010000:0.0:1789049943.163102:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.163117:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049943.163124:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3282:x1875954704088960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049943.163131:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049943.163135:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.163143:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.163153:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd24a00/0x9df728c939b78891 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7888a expref: 18 pid: 5810 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.163162:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049943.163188:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3282:x1875954704088960:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.163221:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789049943.163876:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05f800/0x9df728c939b78a19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6f1 expref: 9 pid: 5811 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.163889:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875954704088320:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789049943.163918:0:8500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049943.164043:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704088832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049943.164073:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704088960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049943.164255:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.164263:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049943.164281:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.164289:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05fa00/0x9df728c939b78828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7882f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.164304:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049943.164307:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049943.164308:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049943.164315:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049943.164415:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704089088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049943.164454:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049943.164523:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089088 00000100:00100000:2.0:1789049943.164597:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089088 00010000:00010000:2.0:1789049943.164619:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 17 pid: 5812 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049943.164650:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049943.164658:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3283:x1875954704089088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789049943.164667:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049943.164671:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 17 pid: 5812 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164680:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 17 pid: 5812 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164693:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd24400/0x9df728c939b7882f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78828 expref: 17 pid: 5812 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164706:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164714:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164734:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164742:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164748:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164755:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164761:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0ee00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789049943.164765:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164773:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164794:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049943.164871:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049943.164904:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3283:x1875954704089088:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.164912:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049943.164977:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704089088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049943.165026:0:8500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.165034:0:8500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.165041:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78aba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049943.181602:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049943.306876:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.307991:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478784 00000100:00100000:3.0:1789049943.308003:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478784 00000100:00100000:3.0:1789049943.308060:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 169 00000100:00100000:3.0:1789049943.308071:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:5591:x1875954691478784:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049943.308090:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049943.308111:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f730 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.308142:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.308154:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049943.308164:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488600, rc 0) 00000100:00100000:3.0:1789049943.308254:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478784:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 184us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.308261:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 169 00000100:00100000:0.0:1789049943.317006:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.317687:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691478912 00000100:00100000:3.0:1789049943.317697:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691478912 00000100:00100000:3.0:1789049943.317747:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 170 00000100:00100000:3.0:1789049943.317766:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478912:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049943.318032:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691478912:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 267us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.318040:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 170 00000100:00100000:3.0:1789049943.319870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049943.319941:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479040 00000100:00100000:1.0:1789049943.319950:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479040 00000100:00100000:1.0:1789049943.319996:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 171 00000100:00100000:1.0:1789049943.320005:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691479040:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049943.320276:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:5591:x1875954691479040:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 271us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049943.320283:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 171 00000100:00100000:3.0:1789049943.327082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049943.328094:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479168 00000100:00100000:2.0:1789049943.328106:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479168 00000100:00100000:2.0:1789049943.328168:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 172 00000100:00100000:2.0:1789049943.328185:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:6093:x1875954691479168:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049943.328441:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:6093:x1875954691479168:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 256us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.328450:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 172 00000100:00100000:2.0:1789049943.331954:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.332025:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479296 00000100:00100000:3.0:1789049943.332035:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479296 00000100:00100000:3.0:1789049943.332085:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 173 00000100:00100000:3.0:1789049943.332097:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:6093:x1875954691479296:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049943.332346:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:6093:x1875954691479296:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 251us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.332355:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 173 00000100:00100000:2.0:1789049943.760790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.761177:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479424 00000100:00100000:3.0:1789049943.761187:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479424 00000100:00100000:3.0:1789049943.761267:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 174 00000100:00100000:3.0:1789049943.761278:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691479424:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049943.761349:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691479424:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 72us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049943.761356:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 174 00000100:00100000:3.0:1789049943.766981:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.767020:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049943.767056:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049943.767076:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479552 00000100:00100000:2.0:1789049943.767085:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479552 00000100:00100000:0.0:1789049943.767111:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479808 00000100:00100000:0.0:1789049943.767115:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479808 00000100:00100000:0.0:1789049943.767149:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479680 00000100:00100000:0.0:1789049943.767151:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479680 00000100:00100000:2.0:1789049943.767154:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789049943.767163:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691479552:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049943.767172:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789049943.767177:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691479808:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049943.767255:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691479552:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.767263:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00080000:3.0:1789049943.767281:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049943.767285:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049943.767286:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00080000:3.0:1789049943.767288:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049943.767292:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691479680:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049943.770081:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691479808:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 2892us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049943.770095:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789049943.772073:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691479680:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 4771us (5007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049943.772086:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00010000:00010000:3.0:1789049944.203769:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049944.718783:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049944.718818:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704089216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049944.718880:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049944.718940:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089216 00000100:00100000:1.0:1789049944.718947:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089216 00000100:00100000:1.0:1789049944.718996:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049944.719006:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704089216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049944.719039:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049944.719081:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704089216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049944.719087:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789049944.719106:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789049944.719132:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c95500 x1875954704089216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049944.719150:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704089216:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789049945.036270:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049945.036277:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95073d0e4000 from 4 10000000:01000000:2.0:1789049945.036283:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049945.036325:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049945.036336:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049945.036359:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049945.036382:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049945.036441:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049945.036493:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.036639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089344 00000100:00100000:3.0:1789049945.036646:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089344 00000100:00100000:3.0:1789049945.036698:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789049945.036707:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704089344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049945.036720:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049945.036733:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78ac8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.036761:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.036772:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.036779:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489200, rc 0) 00000100:00100000:3.0:1789049945.037002:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.037010:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789049945.037151:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049945.037166:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049945.037173:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049945.037256:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049945.037281:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049945.037309:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.037393:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089472 00000100:00100000:3.0:1789049945.037398:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089472 00000100:00100000:3.0:1789049945.037427:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789049945.037434:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.037966:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 531us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.037973:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789049945.038054:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049945.038084:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049945.038122:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049945.038150:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.038237:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089600 00000100:00100000:3.0:1789049945.038242:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089600 00000100:00100000:3.0:1789049945.038267:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789049945.038281:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.038411:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.038417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789049945.038599:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049945.043041:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8599:1875954704089728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049945.043114:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049945.043154:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.043236:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089728 00000100:00100000:3.0:1789049945.043243:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089728 00000100:00100000:3.0:1789049945.043287:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789049945.043297:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8599:x1875954704089728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.043497:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8599:x1875954704089728:12345-0@lo:502:llog_process_th.0 Request processed in 202us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.043505:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789049945.043950:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8599:1875954704089728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049945.043980:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049945.043990:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049945.043993:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789049945.044008:0:8599:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95073d0e4000 00000020:00000080:1.0:1789049945.044010:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789049945.044085:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8599:1875954704089856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049945.044123:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049945.044152:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.045645:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089856 00000100:00100000:3.0:1789049945.045655:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089856 00000100:00100000:3.0:1789049945.045701:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789049945.045710:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8599:x1875954704089856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.046100:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:8599:x1875954704089856:12345-0@lo:502:llog_process_th.0 Request processed in 392us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.046108:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789049945.046264:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8599:1875954704089856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049945.046293:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049945.046300:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049945.046302:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789049945.046308:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789049945.046887:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789049945.046911:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049945.046920:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.046932:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049945.046942:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049945.046949:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95071009a800 from 4 10000000:01000000:3.0:1789049945.046952:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049945.046979:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.046987:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.046996:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049945.047014:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.047050:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.047081:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.047097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704089984 00000100:00100000:3.0:1789049945.047101:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704089984 00000100:00100000:3.0:1789049945.047129:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789049945.047136:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704089984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049945.047147:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049945.047158:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78ad6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.047177:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.047186:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.047193:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489600, rc 0) 00000100:00100000:3.0:1789049945.047257:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704089984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.047269:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789049945.047301:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704089984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049945.047313:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.047321:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049945.047364:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.047387:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.047403:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.047413:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090112 00000100:00100000:3.0:1789049945.047417:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090112 00000100:00100000:3.0:1789049945.047437:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789049945.047443:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704090112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.048788:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704090112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1341us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.048812:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789049945.048869:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.048907:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.048947:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.048964:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.048978:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090240 00000100:00100000:3.0:1789049945.048983:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090240 00000100:00100000:3.0:1789049945.049007:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789049945.049021:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704090240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.049169:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704090240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.049175:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789049945.049239:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.049398:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8601:1875954704090368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.049431:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.049449:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090368 00000100:00100000:3.0:1789049945.049452:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090368 00000100:00100000:3.0:1789049945.049472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789049945.049478:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8601:x1875954704090368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.049587:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8601:x1875954704090368:12345-0@lo:502:llog_process_th.0 Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.049593:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789049945.049621:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.050972:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8601:1875954704090368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049945.051004:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049945.051013:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049945.051016:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789049945.051022:0:8601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95071009a800 00000020:00000080:3.0:1789049945.051025:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049945.051087:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8601:1875954704090496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.051139:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.051170:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090496 00000100:00100000:3.0:1789049945.051175:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090496 00000100:00100000:3.0:1789049945.051237:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789049945.051244:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8601:x1875954704090496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.051389:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:8601:x1875954704090496:12345-0@lo:502:llog_process_th.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.051396:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789049945.051428:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.051440:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8601:1875954704090496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049945.051456:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049945.051460:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049945.051461:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789049945.051465:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789049945.051518:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789049945.051534:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049945.051542:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.051551:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049945.051560:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049945.051562:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950707961800 from 4 10000000:01000000:3.0:1789049945.051564:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049945.051586:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.051593:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.051602:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049945.051620:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.053078:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.053105:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.053126:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090624 00000100:00100000:3.0:1789049945.053132:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090624 00000100:00100000:3.0:1789049945.053164:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789049945.053172:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704090624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049945.053183:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049945.053210:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78ae4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.053242:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.053251:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.053259:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488a00, rc 0) 00000100:00100000:3.0:1789049945.053292:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704090624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.053298:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789049945.053338:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049945.053351:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.053359:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049945.053419:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.057995:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.058037:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090752 00000100:00100000:3.0:1789049945.058046:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090752 00000100:00100000:3.0:1789049945.058088:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789049945.058096:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704090752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.058356:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704090752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.058363:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789049945.058405:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.058426:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.058471:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.058510:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.058531:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704090880 00000100:00100000:3.0:1789049945.058534:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704090880 00000100:00100000:3.0:1789049945.058555:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789049945.058561:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704090880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.058698:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704090880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.058704:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789049945.058732:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.058743:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704090880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049945.058926:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8602:1875954704091008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.058963:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.058982:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091008 00000100:00100000:3.0:1789049945.058986:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091008 00000100:00100000:3.0:1789049945.059007:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789049945.059013:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:8602:x1875954704091008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.059122:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:8602:x1875954704091008:12345-0@lo:502:llog_process_th.0 Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.059129:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789049945.059157:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720ac86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.059168:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8602:1875954704091008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049945.059189:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049945.059228:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049945.059232:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789049945.059241:0:8602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950707961800 00000020:00000080:3.0:1789049945.059243:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049945.059300:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8602:1875954704091136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.059331:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049945.059350:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091136 00000100:00100000:3.0:1789049945.059354:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091136 00000100:00100000:3.0:1789049945.059373:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789049945.059379:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:8602:x1875954704091136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049945.059475:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:8602:x1875954704091136:12345-0@lo:502:llog_process_th.0 Request processed in 96us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049945.059482:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789049945.059508:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049945.059519:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:8602:1875954704091136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049945.059541:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049945.059546:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049945.059547:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789049945.059551:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789049945.059593:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789049945.059606:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049945.059614:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049945.059625:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049945.232333:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049946.258380:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049946.763484:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704091392:0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.763551:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049946.763616:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704091904:0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.763643:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049946.763672:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049946.763679:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704091520:0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.763701:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049946.763734:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091904 00000100:00100000:1.0:1789049946.763740:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091904 00000100:00100000:1.0:1789049946.763786:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049946.763794:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704091904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.763839:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704091904:12345-0@lo:400:kworker.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049946.763845:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049946.763866:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091392 00000100:00100000:1.0:1789049946.763869:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091392 00000100:00100000:1.0:1789049946.763887:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091520 00000100:00100000:1.0:1789049946.763900:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091520 00000100:00100000:1.0:1789049946.763921:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049946.763927:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.763956:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704091392:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049946.763961:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049946.763971:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789049946.763977:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.764015:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704091520:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049946.764020:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789049946.764036:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049946.764039:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049946.764066:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704091520:0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.764075:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704091392:0@lo:400:kworker.0 00010000:00080000:1.0:1789049946.764086:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c97480 x1875954704091904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049946.764095:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704091904:0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764412:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704091264:0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764447:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049946.764481:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704091776:0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764504:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049946.764524:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049946.764529:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704091648:0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764550:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049946.764575:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091776 00000100:00100000:2.0:1789049946.764579:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091776 00000100:00100000:2.0:1789049946.764622:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049946.764629:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704091776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764663:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704091776:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049946.764669:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049946.764688:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091648 00000100:00100000:2.0:1789049946.764691:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091648 00000100:00100000:2.0:1789049946.764713:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049946.764719:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704091648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764744:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704091648:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049946.764749:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789049946.764762:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049946.764765:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049946.764782:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c95180 x1875954704091648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049946.764791:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704091648:0@lo:400:kworker.0 00000100:00100000:2.0:1789049946.764812:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704091776:0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.765237:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704091264 00000100:00100000:1.0:1789049946.765241:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704091264 00000100:00100000:1.0:1789049946.765274:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789049946.765281:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704091264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049946.765324:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704091264:12345-0@lo:400:kworker.0 Request processed in 44us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049946.765330:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789049946.765407:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704091264:0@lo:400:kworker.0 00000100:00100000:3.0:1789049947.275514:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704092032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049947.275596:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049947.275667:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092032 00000100:00100000:3.0:1789049947.275673:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092032 00000100:00100000:3.0:1789049947.275717:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049947.275726:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704092032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049947.275757:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049947.275800:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704092032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049947.275807:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789049947.275848:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1a5c00 x1875954704092032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049947.275866:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704092032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789049947.277696:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049948.299381:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049948.877097:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049948.877147:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049948.877173:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049948.877221:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049948.877249:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480192 00000100:00100000:2.0:1789049948.877259:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480192 00000100:00100000:2.0:1789049948.877310:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480320 00000100:00100000:2.0:1789049948.877313:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480320 00000100:00100000:2.0:1789049948.877333:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789049948.877343:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691480192:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049948.877407:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691480192:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.877414:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789049948.877428:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789049948.877435:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691480320:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049948.877456:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691480320:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 22us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.877461:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789049948.877476:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480064 00000100:00100000:2.0:1789049948.877479:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480064 00000100:00100000:2.0:1789049948.877506:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:2.0:1789049948.877512:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691480064:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049948.877539:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691480064:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049948.877554:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00080000:2.0:1789049948.877573:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049948.877577:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049948.877578:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049948.878966:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691479936 00000100:00100000:3.0:1789049948.878976:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691479936 00000100:00100000:3.0:1789049948.879027:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 191 00000100:00100000:3.0:1789049948.879036:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691479936:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049948.879094:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691479936:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 59us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049948.879101:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 191 00000001:02000400:3.0:1789049948.953525:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789049949.328658:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049949.835396:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704092160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049949.835462:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049949.835716:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092160 00000100:00100000:1.0:1789049949.835724:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092160 00000100:00100000:1.0:1789049949.835961:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049949.835970:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704092160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049949.836002:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049949.836042:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704092160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049949.836048:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789049949.836117:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb2d80 x1875954704092160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049949.836133:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704092160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789049949.840398:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049950.347623:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049951.371605:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049951.885509:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704092288:0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.885580:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.885628:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704092800:0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.885654:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.885681:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049951.885688:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704092672:0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.885712:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049951.885745:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092800 00000100:00100000:1.0:1789049951.885752:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092800 00000100:00100000:0.0:1789049951.885894:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092672 00000100:00100000:0.0:1789049951.885899:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092672 00000100:00100000:0.0:1789049951.885955:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049951.885968:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704092672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049951.886034:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704092672:12345-0@lo:400:kworker.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049951.886042:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789049951.886064:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049951.886094:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c96300 x1875954704092672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049951.886107:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704092672:0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.887331:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049951.887343:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704092800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.887407:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704092800:12345-0@lo:400:kworker.0 Request processed in 68us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.887415:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789049951.887611:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049951.887651:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704092800:0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.887858:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704092416:0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.887896:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.887934:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704092928:0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.887959:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.887982:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049951.887989:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704092544:0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.888010:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049951.888044:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092288 00000100:00100000:3.0:1789049951.888050:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092288 00000100:00100000:3.0:1789049951.888079:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789049951.888087:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704092288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.888123:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704092288:12345-0@lo:400:kworker.0 Request processed in 37us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.888130:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789049951.888284:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704092288:0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.888430:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092416 00000100:00100000:1.0:1789049951.888445:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092416 00000100:00100000:1.0:1789049951.888470:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092544 00000100:00100000:1.0:1789049951.888473:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092544 00000100:00100000:1.0:1789049951.888494:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789049951.888500:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704092416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.888538:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704092416:12345-0@lo:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.888543:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789049951.888555:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789049951.888561:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049951.888585:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704092544:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049951.888590:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789049951.888645:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049951.889301:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704092928 00000100:00100000:3.0:1789049951.889307:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704092928 00000100:00100000:3.0:1789049951.889356:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049951.889363:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704092928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.889411:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704092928:12345-0@lo:400:kworker.0 Request processed in 48us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049951.889418:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049951.889457:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704092544:0@lo:400:kworker.0 00000100:00100000:3.0:1789049951.889466:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704092416:0@lo:400:kworker.0 00010000:00080000:3.0:1789049951.889476:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736c97480 x1875954704092928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049951.889485:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704092928:0@lo:400:kworker.0 00000100:00080000:0.0:1789049951.889567:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789049952.395310:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049952.395493:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704093056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049952.395560:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049952.395654:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093056 00000100:00100000:2.0:1789049952.395662:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093056 00000100:00100000:2.0:1789049952.395708:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049952.395717:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704093056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049952.395749:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049952.395978:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704093056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049952.395986:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789049952.396087:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1a7480 x1875954704093056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049952.396105:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704093056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789049953.420860:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049954.003601:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049954.003636:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049954.003666:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049954.003700:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049954.004587:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480832 00000100:00100000:1.0:1789049954.004592:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480704 00000100:00100000:1.0:1789049954.004599:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480704 00000100:00100000:0.0:1789049954.004599:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480832 00000100:00100000:1.0:1789049954.004671:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:1.0:1789049954.004682:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691480704:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049954.005043:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:0.0:1789049954.005054:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691480832:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049954.005360:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480448 00000100:00100000:3.0:1789049954.005366:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480448 00000100:00100000:3.0:1789049954.005398:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 193 00000100:00100000:3.0:1789049954.005406:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2350:x1875954691480448:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049954.006087:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691480704:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 1404us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049954.006098:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:0.0:1789049954.008667:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691480832:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 3606us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049954.008680:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:0.0:1789049954.008724:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480576 00000100:00100000:0.0:1789049954.008732:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480576 00000100:00100000:0.0:1789049954.008843:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:0.0:1789049954.008854:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691480576:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049954.008917:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691480576:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 66us (5325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049954.008933:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00080000:0.0:1789049954.009015:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049954.009020:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049954.009023:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049954.009385:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2350:x1875954691480448:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 3977us (5715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049954.009395:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 193 00000001:02000400:0.0:1789049954.131551:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing yml_node 00010000:00010000:0.0:1789049954.443888:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049954.962356:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049954.962376:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704093184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049954.962436:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049954.962487:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093184 00000100:00100000:2.0:1789049954.962494:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093184 00000100:00100000:2.0:1789049954.962541:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049954.962549:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704093184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049954.962580:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049954.962616:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704093184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049954.962622:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789049954.962639:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049954.962672:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17e300 x1875954704093184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049954.962687:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704093184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049955.467359:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049956.494364:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049957.003907:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704093312:0@lo:400:kworker.0 00000100:00100000:2.0:1789049957.003988:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049957.004097:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093312 00000100:00100000:0.0:1789049957.004106:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093312 00000100:00100000:0.0:1789049957.004176:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789049957.004187:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.004980:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704093696:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005035:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049957.005075:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093696 00000100:00100000:1.0:1789049957.005081:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093696 00000100:00100000:1.0:1789049957.005120:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049957.005128:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704093696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005179:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704093696:12345-0@lo:400:kworker.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049957.005186:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789049957.005234:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d0e00 x1875954704093696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049957.005248:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704093696:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005362:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704093568:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005393:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049957.005411:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049957.005416:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704093440:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005435:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049957.005483:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093568 00000100:00100000:1.0:1789049957.005487:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093568 00000100:00100000:1.0:1789049957.005514:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093440 00000100:00100000:1.0:1789049957.005516:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093440 00000100:00100000:1.0:1789049957.005534:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049957.005540:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704093568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005581:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704093568:12345-0@lo:400:kworker.0 Request processed in 41us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049957.005589:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049957.005600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049957.005607:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704093440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005632:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704093440:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049957.005638:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049957.005670:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704093440:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.005679:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704093568:0@lo:400:kworker.0 00000100:00080000:1.0:1789049957.005703:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049957.005708:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049957.006135:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704093312:12345-0@lo:400:kworker.0 Request processed in 1948us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049957.006144:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789049957.006283:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049957.006292:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704093952:0@lo:400:kworker.0 00000100:00100000:3.0:1789049957.006332:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049957.006364:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093952 00000100:00100000:3.0:1789049957.006370:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093952 00000100:00100000:3.0:1789049957.006402:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049957.006410:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704093952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049957.006446:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704093952:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049957.006473:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789049957.006504:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d0e00 x1875954704093952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049957.006515:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704093952:0@lo:400:kworker.0 00000100:00080000:1.0:1789049957.006664:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049957.006673:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049957.006681:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704093824:0@lo:400:kworker.0 00000100:00100000:1.0:1789049957.006709:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049957.006842:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704093824 00000100:00100000:3.0:1789049957.006847:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704093824 00000100:00100000:3.0:1789049957.006892:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049957.006899:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704093824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049957.006934:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704093824:12345-0@lo:400:kworker.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049957.006940:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789049957.007056:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704093824:0@lo:400:kworker.0 00000100:00080000:1.0:1789049957.007145:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049957.007224:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704093312:0@lo:400:kworker.0 00010000:00010000:3.0:1789049957.515342:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049957.515960:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704094080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049957.516054:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049957.516172:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094080 00000100:00100000:2.0:1789049957.516182:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094080 00000100:00100000:2.0:1789049957.516586:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049957.516597:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704094080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049957.516641:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049957.517086:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704094080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 489us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049957.517095:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789049957.517608:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cbb80 x1875954704094080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049957.517631:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704094080:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789049957.918067:0:9235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789049958.539409:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049959.126336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049959.126393:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049959.126579:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481088 00000100:00100000:3.0:1789049959.126585:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691480960 00000100:00100000:1.0:1789049959.126591:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481088 00000100:00100000:3.0:1789049959.126592:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691480960 00000100:00100000:1.0:1789049959.126673:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:3.0:1789049959.126676:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 195 00000100:00100000:3.0:1789049959.126688:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691480960:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049959.126704:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481088:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049959.126779:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691480960:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 93us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049959.126787:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 195 00000100:00080000:2.0:1789049959.127013:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049959.134468:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481088:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 7750us (8056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049959.134487:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789049959.150950:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049959.151008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049959.151373:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481216 00000100:00100000:0.0:1789049959.151387:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481216 00000100:00100000:0.0:1789049959.151469:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481344 00000100:00100000:0.0:1789049959.151473:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481344 00000100:00100000:0.0:1789049959.151497:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789049959.151508:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2346:x1875954691481216:12345-192.168.206.1@tcp:9:kworker.0 00000100:00100000:3.0:1789049959.151548:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000020:00000080:0.0:1789049959.151556:0:8215:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78a2e 00000100:00100000:3.0:1789049959.151563:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2346:x1875954691481344:12345-192.168.206.1@tcp:9:kworker.0 00000100:00080000:0.0:1789049959.151571:0:8215:0:(import.c:65:import_set_state_nolock()) ffff950605b88800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789049959.151591:0:6671:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78a27 00000100:00080000:3.0:1789049959.151601:0:6671:0:(import.c:65:import_set_state_nolock()) ffff950605b8e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789049959.151619:0:8215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1789049959.151637:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1789049959.151994:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049959.151999:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789049959.152012:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049959.152578:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049959.153658:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+2:2346:x1875954691481344:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 2086us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049959.153692:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789049959.154339:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+2:2346:x1875954691481216:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 2822us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049959.155658:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00010000:00010000:2.0:1789049959.564721:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049960.080220:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704094208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049960.080307:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049960.080404:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094208 00000100:00100000:2.0:1789049960.080413:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094208 00000100:00100000:2.0:1789049960.080472:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049960.080482:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704094208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049960.080522:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049960.080569:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704094208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049960.080576:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789049960.080599:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049960.080631:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17d880 x1875954704094208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049960.080652:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704094208:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789049960.130823:0:9334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000001:00100000:2.0:1789049960.166039:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:2.0:1789049960.166051:0:6698:0:(genops.c:885:class_export_put()) final put ffff950605b89000/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:2.0:1789049960.166086:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff950605b89000/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-OST0000 00000020:00000080:2.0:1789049960.166155:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605b88800 for lustre-OST0000 00010000:00010000:3.0:1789049960.587818:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049961.614289:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049962.125434:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704094720:0@lo:400:kworker.0 00000100:00100000:0.0:1789049962.125525:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049962.125598:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789049962.125605:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704094336:0@lo:400:kworker.0 00000100:00100000:0.0:1789049962.125638:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049962.125663:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704094848:0@lo:400:kworker.0 00000100:00100000:0.0:1789049962.125689:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049962.125940:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094720 00000100:00100000:1.0:1789049962.125951:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094720 00000100:00100000:1.0:1789049962.126015:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049962.126027:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704094720:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789049962.132611:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049962.132651:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704094464:0@lo:400:kworker.0 00000100:00100000:1.0:1789049962.133165:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704094720:12345-0@lo:400:kworker.0 Request processed in 7137us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049962.133179:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049962.133260:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094336 00000100:00100000:1.0:1789049962.133273:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094336 00000100:00100000:1.0:1789049962.133330:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789049962.133341:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704094336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049962.133404:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704094336:12345-0@lo:400:kworker.0 Request processed in 64us (7764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049962.133410:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789049962.136553:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094848 00000100:00100000:1.0:1789049962.136577:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094848 00000100:00100000:1.0:1789049962.136666:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789049962.136697:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704094848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049962.136818:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704094848:12345-0@lo:400:kworker.0 Request processed in 140us (11127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049962.136848:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789049962.136873:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049962.142266:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704094592:0@lo:400:kworker.0 00000100:00100000:2.0:1789049962.142375:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049962.142865:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094592 00000100:00100000:1.0:1789049962.142876:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094592 00000100:00100000:1.0:1789049962.142952:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049962.142964:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049962.143036:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704094592:12345-0@lo:400:kworker.0 Request processed in 74us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049962.143044:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789049962.143070:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049962.143934:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704094848:0@lo:400:kworker.0 00010000:00080000:0.0:1789049962.143954:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950736cb3800 x1875954704094720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049962.143965:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704094720:0@lo:400:kworker.0 00000100:00100000:0.0:1789049962.143998:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704094336:0@lo:400:kworker.0 00000100:00100000:2.0:1789049962.144111:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704094592:0@lo:400:kworker.0 00000100:00100000:3.0:1789049962.145822:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049962.145956:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704094976:0@lo:400:kworker.0 00000100:00100000:3.0:1789049962.146013:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049962.147735:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094976 00000100:00100000:0.0:1789049962.147756:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094976 00000100:00100000:0.0:1789049962.147874:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049962.147891:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704094976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049962.148005:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704094976:12345-0@lo:400:kworker.0 Request processed in 120us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049962.148014:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789049962.148188:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950702d7f480 x1875954704094976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049962.148245:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704094976:0@lo:400:kworker.0 00000100:00080000:2.0:1789049962.148369:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049962.153745:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704094464 00000100:00100000:1.0:1789049962.153767:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704094464 00000100:00100000:1.0:1789049962.153850:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049962.153863:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049962.153991:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704094464:12345-0@lo:400:kworker.0 Request processed in 130us (8178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049962.153998:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049962.155505:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704094464:0@lo:400:kworker.0 00010000:00010000:0.0:1789049962.637470:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049962.643143:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049962.643172:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704095104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049962.643273:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049962.643297:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095104 00000100:00100000:2.0:1789049962.643308:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095104 00000100:00100000:2.0:1789049962.643364:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049962.643376:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704095104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049962.643439:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049962.643510:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704095104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049962.643533:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789049962.643715:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7c9180 x1875954704095104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049962.643738:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704095104:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789049962.689908:0:9432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000001:00100000:3.0:1789049963.249589:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:3.0:1789049963.249600:0:7634:0:(genops.c:885:class_export_put()) final put ffff950605b8a800/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:0.0:1789049963.249952:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff950605b8a800/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-OST0001 00000020:00000080:0.0:1789049963.250016:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605b8e000 for lustre-OST0001 00010000:00010000:3.0:1789049963.663558:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049964.250663:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049964.252255:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049964.252297:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481472 00000100:00100000:3.0:1789049964.252307:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481472 00000100:00100000:3.0:1789049964.252367:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 197 00000100:00100000:3.0:1789049964.252377:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691481472:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049964.252444:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691481472:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 68us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049964.252452:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 197 00000100:00100000:2.0:1789049964.252961:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481600 00000100:00100000:2.0:1789049964.252967:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481600 00000100:00100000:2.0:1789049964.253013:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:2.0:1789049964.253277:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481600:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049964.253327:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481600:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 306us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049964.253334:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00080000:3.0:1789049964.253480:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789049964.369919:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 10:19:23 EDT 2026 00010000:00010000:1.0:1789049964.683474:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049965.197022:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049965.197042:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704095232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049965.197104:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049965.198035:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095232 00000100:00100000:2.0:1789049965.198045:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095232 00000100:00100000:2.0:1789049965.198132:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049965.198141:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704095232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049965.198171:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049965.198238:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704095232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049965.198244:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789049965.198286:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7ca680 x1875954704095232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049965.198304:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704095232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789049965.198751:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049965.707912:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049966.731992:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049967.243596:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704095616:0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.243738:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704095744:0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.243797:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.243849:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789049967.243856:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704095360:0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.243881:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.243904:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704095872:0@lo:400:kworker.0 00000100:00100000:2.0:1789049967.244525:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.244546:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704095488:0@lo:400:kworker.0 00000100:00100000:3.0:1789049967.244578:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.244604:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704096000:0@lo:400:kworker.0 00000100:00100000:3.0:1789049967.244626:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.244632:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049967.244679:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095744 00000100:00100000:3.0:1789049967.244703:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095616 00000100:00100000:3.0:1789049967.244711:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095616 00000100:00100000:3.0:1789049967.244772:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095488 00000100:00100000:3.0:1789049967.244776:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095488 00000100:00100000:3.0:1789049967.244789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095872 00000100:00100000:3.0:1789049967.244792:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095872 00000100:00100000:3.0:1789049967.244808:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789049967.244818:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704095616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049967.244872:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704095616:12345-0@lo:400:kworker.0 Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049967.244879:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789049967.244896:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789049967.244910:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049967.244946:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704095488:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.244949:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095744 00000100:00100000:3.0:1789049967.244952:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789049967.244964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789049967.244969:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704095872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.244978:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096000 00000100:00100000:1.0:1789049967.244981:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096000 00000100:00100000:1.0:1789049967.245005:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049967.245012:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704095744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.245048:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704095744:12345-0@lo:400:kworker.0 Request processed in 37us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.245055:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049967.245070:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789049967.245076:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704096000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.245117:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704096000:12345-0@lo:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.245123:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789049967.245142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704095360 00000100:00100000:1.0:1789049967.245146:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704095360 00000100:00100000:1.0:1789049967.245170:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789049967.245177:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704095360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.245225:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704095360:12345-0@lo:400:kworker.0 Request processed in 48us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049967.245231:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789049967.245508:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704095872:12345-0@lo:400:kworker.0 Request processed in 537us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049967.245516:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789049967.245535:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049967.245539:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049967.245541:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049967.245571:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704095488:0@lo:400:kworker.0 00010000:00080000:3.0:1789049967.245585:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1b4000 x1875954704096000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049967.245595:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704096000:0@lo:400:kworker.0 00000100:00100000:3.0:1789049967.245627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704095616:0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.245800:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704095360:0@lo:400:kworker.0 00000100:00100000:1.0:1789049967.245812:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704095872:0@lo:400:kworker.0 00010000:00080000:1.0:1789049967.245823:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17d180 x1875954704095744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049967.245831:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704095744:0@lo:400:kworker.0 00000100:00100000:0.0:1789049967.755505:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049967.755530:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704096128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049967.755598:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049967.755740:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096128 00000100:00100000:3.0:1789049967.755748:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096128 00000100:00100000:3.0:1789049967.755795:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789049967.755805:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704096128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049967.755838:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049967.755898:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704096128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049967.755905:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789049967.756119:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7c9880 x1875954704096128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049967.756138:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704096128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789049967.758303:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049968.781294:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049969.357824:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049969.357866:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049969.357939:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481728 00000100:00100000:3.0:1789049969.357949:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481728 00000100:00100000:3.0:1789049969.358000:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 199 00000100:00100000:3.0:1789049969.358010:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691481728:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049969.358309:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481856 00000100:00100000:1.0:1789049969.358315:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481856 00000100:00100000:1.0:1789049969.358368:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789049969.358376:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481856:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049969.358442:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691481856:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 67us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049969.358449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00080000:0.0:1789049969.358506:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049969.358643:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691481728:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 633us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049969.358650:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 199 00010000:00010000:3.0:1789049969.806024:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049970.315868:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049970.318520:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704096256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049970.318596:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049970.323048:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096256 00000100:00100000:0.0:1789049970.323061:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096256 00000100:00100000:0.0:1789049970.323142:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049970.323154:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704096256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049970.323195:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049970.323285:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704096256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049970.323293:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789049970.323312:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049970.323345:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cad80 x1875954704096256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049970.323376:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704096256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049970.828290:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049971.852300:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049972.363615:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704096384:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363678:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049972.363724:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704096896:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363762:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049972.363784:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049972.363790:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704096768:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363813:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049972.363835:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704096512:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363856:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049972.363869:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704097024:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363887:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049972.363901:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049972.363906:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704096640:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.363929:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049972.364053:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096384 00000100:00100000:1.0:1789049972.364061:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096384 00000100:00100000:1.0:1789049972.364119:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789049972.364128:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704096384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364188:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704096384:12345-0@lo:400:kworker.0 Request processed in 61us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364195:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789049972.364252:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096896 00000100:00100000:1.0:1789049972.364256:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096896 00000100:00100000:1.0:1789049972.364289:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096512 00000100:00100000:1.0:1789049972.364292:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096512 00000100:00100000:1.0:1789049972.364303:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096640 00000100:00100000:1.0:1789049972.364305:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096640 00000100:00100000:1.0:1789049972.364317:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789049972.364323:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364353:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704096896:12345-0@lo:400:kworker.0 Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364359:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789049972.364377:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789049972.364383:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364412:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704096512:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364417:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789049972.364429:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049972.364435:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704096640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364460:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704096640:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364466:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049972.364484:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704096768 00000100:00100000:1.0:1789049972.364488:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704096768 00000100:00100000:1.0:1789049972.364511:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097024 00000100:00100000:1.0:1789049972.364514:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097024 00000100:00100000:1.0:1789049972.364531:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049972.364537:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704096768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364566:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704096768:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364571:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049972.364582:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789049972.364588:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704097024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049972.364614:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704097024:12345-0@lo:400:kworker.0 Request processed in 27us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.364620:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789049972.364744:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950702d7f100 x1875954704096768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049972.364758:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704096768:0@lo:400:kworker.0 00000100:00100000:2.0:1789049972.364767:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704096384:0@lo:400:kworker.0 00000100:00100000:2.0:1789049972.364776:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704096896:0@lo:400:kworker.0 00000100:00080000:0.0:1789049972.364860:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049972.364864:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049972.364866:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049972.364886:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704096640:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.364897:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704096512:0@lo:400:kworker.0 00010000:00080000:0.0:1789049972.364906:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950702d7ca80 x1875954704097024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049972.364914:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704097024:0@lo:400:kworker.0 00000100:00100000:0.0:1789049972.875383:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049972.875405:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704097152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049972.875491:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049972.875576:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049972.875988:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097152 00000100:00100000:1.0:1789049972.875997:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097152 00000100:00100000:1.0:1789049972.876044:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049972.876076:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704097152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049972.876336:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049972.876409:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704097152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049972.876417:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789049972.880142:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7c8380 x1875954704097152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049972.880169:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704097152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789049973.899388:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049974.474137:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049974.474243:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049974.474330:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482112 00000100:00100000:3.0:1789049974.474341:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482112 00000100:00080000:2.0:1789049974.474485:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049974.474522:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691481984 00000100:00100000:2.0:1789049974.474526:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691481984 00000100:00100000:2.0:1789049974.474575:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 201 00000100:00100000:2.0:1789049974.474586:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2350:x1875954691481984:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049974.474836:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2350:x1875954691481984:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 250us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049974.474844:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 201 00000100:00100000:3.0:1789049974.474974:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789049974.474983:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691482112:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049974.475020:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691482112:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 39us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049974.475027:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00010000:00010000:2.0:1789049974.924911:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049975.440498:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049975.440531:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049975.440617:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049975.440695:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097280 00000100:00100000:3.0:1789049975.440705:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097280 00000100:00100000:3.0:1789049975.440770:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049975.440780:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704097280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049975.440825:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049975.440875:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704097280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049975.440884:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789049975.440928:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049975.440962:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cb100 x1875954704097280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049975.440982:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704097280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789049975.947456:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049976.971602:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049977.483440:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704097408:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.483469:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704097536:0@lo:400:kworker.0 00000100:00100000:0.0:1789049977.483571:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704097792:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.485750:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.485830:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704098048:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.485875:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.485916:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049977.485924:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704097664:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.485948:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.485993:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098048 00000100:00100000:1.0:1789049977.486002:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098048 00000100:00100000:1.0:1789049977.486085:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049977.486096:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.486163:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704098048:12345-0@lo:400:kworker.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.486171:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049977.486218:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097536 00000100:00100000:1.0:1789049977.486222:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097536 00000100:00100000:1.0:1789049977.486251:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097664 00000100:00100000:1.0:1789049977.486254:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097664 00000100:00100000:1.0:1789049977.486279:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049977.486286:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.486322:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704097536:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.486347:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049977.486361:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049977.486367:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.486397:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704097664:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.486402:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789049977.486419:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049977.486425:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049977.486469:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704097664:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.486483:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704097536:0@lo:400:kworker.0 00010000:00080000:1.0:1789049977.486496:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073cd6c700 x1875954704098048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049977.486507:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704098048:0@lo:400:kworker.0 00000100:00100000:2.0:1789049977.487718:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049977.487797:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704097920:0@lo:400:kworker.0 00000100:00100000:2.0:1789049977.487853:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.488143:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097920 00000100:00100000:3.0:1789049977.488155:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097920 00000100:00100000:3.0:1789049977.488258:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789049977.488269:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049977.488352:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704097920:12345-0@lo:400:kworker.0 Request processed in 85us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.488360:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789049977.488411:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704097920:0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.488500:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097408 00000100:00100000:1.0:1789049977.488506:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097408 00000100:00100000:1.0:1789049977.488549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789049977.488559:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704097408:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789049977.488586:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049977.488627:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704097408:12345-0@lo:400:kworker.0 Request processed in 58us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.488635:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789049977.488798:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704097408:0@lo:400:kworker.0 00000100:00100000:0.0:1789049977.489159:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049977.489359:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704097792 00000100:00100000:1.0:1789049977.489365:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704097792 00000100:00080000:2.0:1789049977.489473:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049977.489510:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789049977.489535:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049977.489585:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704097792:12345-0@lo:400:kworker.0 Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049977.489592:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789049977.489668:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073cd6f800 x1875954704097792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049977.489693:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704097792:0@lo:400:kworker.0 00000001:02000400:1.0:1789049977.926898:0:10110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:19:37 (1789049977) === 00010000:00010000:2.0:1789049977.995818:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049977.998647:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049977.998677:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704098176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049977.998771:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049977.998846:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098176 00000100:00100000:3.0:1789049977.998856:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098176 00000100:00100000:3.0:1789049977.998911:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049977.998921:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704098176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049977.998967:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049977.999020:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704098176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049977.999028:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789049977.999098:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cb100 x1875954704098176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049977.999130:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704098176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049978.254005:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049978.254936:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482240 00000100:00100000:2.0:1789049978.254951:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482240 00000100:00100000:2.0:1789049978.255048:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 203 00000100:00100000:2.0:1789049978.255068:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:8115:x1875954691482240:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789049978.255091:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049978.255117:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700031000/0x9df728c939b78af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f737 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.255156:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031000/0x9df728c939b78af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f737 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.255171:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700031000/0x9df728c939b78af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f737 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049978.255181:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031000, rc 0) 00000100:00100000:2.0:1789049978.255320:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482240:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 254us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.255328:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 203 00000100:00100000:1.0:1789049978.264385:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049978.264486:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482368 00000100:00100000:3.0:1789049978.264499:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482368 00000100:00100000:3.0:1789049978.264574:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 204 00000100:00100000:3.0:1789049978.264588:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482368:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789049978.270762:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482368:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 6161us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049978.270780:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 204 00000100:00100000:3.0:1789049978.274588:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.274684:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482496 00000100:00100000:1.0:1789049978.274698:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482496 00000100:00100000:1.0:1789049978.274764:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 205 00000100:00100000:1.0:1789049978.274777:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482496:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789049978.275226:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482496:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 450us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.275235:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 205 00000100:00100000:2.0:1789049978.289607:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049978.290514:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482624 00000100:00100000:3.0:1789049978.290529:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482624 00000100:00100000:3.0:1789049978.290602:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 206 00000100:00100000:3.0:1789049978.290615:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8119:x1875954691482624:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049978.293933:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8119:x1875954691482624:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 3305us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.293953:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 206 00000100:00100000:0.0:1789049978.314950:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049978.317335:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482752 00000100:00100000:2.0:1789049978.317357:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482752 00000100:00100000:2.0:1789049978.317448:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 207 00000100:00100000:2.0:1789049978.317461:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8119:x1875954691482752:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049978.318716:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8119:x1875954691482752:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 1247us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.318729:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 207 00000100:00100000:2.0:1789049978.328174:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.328432:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691482880 00000100:00100000:1.0:1789049978.328445:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691482880 00000100:00100000:1.0:1789049978.328562:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 208 00000100:00100000:1.0:1789049978.328574:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:8115:x1875954691482880:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789049978.328596:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049978.328624:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05fe00/0x9df728c939b78af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f761 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.328658:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05fe00/0x9df728c939b78af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f761 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.328672:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05fe00/0x9df728c939b78af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f761 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.328700:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05fe00, rc 0) 00000100:00100000:1.0:1789049978.328778:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:8115:x1875954691482880:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 206us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.328786:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 208 00000100:00100000:2.0:1789049978.332926:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049978.333065:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483008 00000100:00100000:3.0:1789049978.333079:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483008 00000100:00100000:3.0:1789049978.333244:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 209 00000100:00100000:3.0:1789049978.333259:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:8115:x1875954691483008:12345-192.168.206.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789049978.333297:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789049978.333330:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789049978.333504:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789049978.333509:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789049978.333512:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789049978.336543:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:8115:x1875954691483008:12345-192.168.206.1@tcp:256:mount.lustre.0 Request processed in 3270us (3850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.336560:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 209 00000100:00100000:2.0:1789049978.341681:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.342708:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483136 00000100:00100000:1.0:1789049978.342726:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483136 00000100:00100000:1.0:1789049978.342849:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 210 00000100:00100000:1.0:1789049978.342862:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:8115:x1875954691483136:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789049978.342885:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049978.342907:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f768 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.342952:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.342966:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049978.342977:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f200, rc 0) 00000100:00100000:1.0:1789049978.343125:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8115:x1875954691483136:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 265us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.343133:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 210 00000100:00100000:2.0:1789049978.346466:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049978.346636:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483264 00000100:00100000:0.0:1789049978.346649:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483264 00000100:00100000:0.0:1789049978.346722:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 211 00000100:00100000:0.0:1789049978.346733:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8115:x1875954691483264:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789049978.347154:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8115:x1875954691483264:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 422us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.347164:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 211 00000100:00100000:2.0:1789049978.349300:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.349405:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483392 00000100:00100000:1.0:1789049978.349417:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483392 00000100:00100000:1.0:1789049978.349513:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 212 00000100:00100000:1.0:1789049978.349525:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8115:x1875954691483392:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789049978.349815:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8115:x1875954691483392:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 291us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.349824:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 212 00000100:00100000:2.0:1789049978.352767:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049978.352968:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483520 00000100:00100000:0.0:1789049978.352982:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483520 00000100:00100000:0.0:1789049978.353161:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 213 00000100:00100000:0.0:1789049978.353175:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8123:x1875954691483520:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789049978.353891:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8123:x1875954691483520:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 714us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.353902:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 213 00000100:00100000:2.0:1789049978.362848:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.367284:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483648 00000100:00100000:1.0:1789049978.367307:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483648 00000100:00100000:1.0:1789049978.367398:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 214 00000100:00100000:1.0:1789049978.367411:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8123:x1875954691483648:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789049978.368476:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:8123:x1875954691483648:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 1061us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.368487:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 214 00000100:00100000:1.0:1789049978.373430:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.373481:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049978.377471:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483776 00000100:00100000:2.0:1789049978.377500:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483776 00000100:00100000:2.0:1789049978.377642:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484160 00000100:00100000:2.0:1789049978.377647:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484160 00000100:00080000:0.0:1789049978.377868:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049978.378599:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:1.0:1789049978.378619:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691484160:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049978.378881:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691484160:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 268us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.378890:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:1.0:1789049978.378919:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:1.0:1789049978.378924:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875954691483776:12345-192.168.206.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789049978.378953:0:5817:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0d9065b0-db35-40d7-baad-6d6fd77aa842@192.168.206.1@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1789049978.379001:0:5817:0:(genops.c:1384:class_connect()) connect: client 0d9065b0-db35-40d7-baad-6d6fd77aa842, cookie 0x9df728c939b78b07 00000004:00100000:1.0:1789049978.379065:0:5817:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789049978.379438:0:5817:0:(import.c:65:import_set_state_nolock()) ffff950605760000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049978.379480:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2346:x1875954691483776:12345-192.168.206.1@tcp:38:mount.lustre.0 Request processed in 554us (6065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.379800:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789049978.383693:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049978.387818:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691483904 00000100:00100000:3.0:1789049978.388593:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691483904 00000100:00100000:1.0:1789049978.388882:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049978.389358:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484032 00000100:00100000:0.0:1789049978.389366:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484032 00000100:00100000:0.0:1789049978.389460:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789049978.389473:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+7:8115:x1875954691484032:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789049978.389532:0:5817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789049978.389641:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+7:8115:x1875954691484032:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 170us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.389649:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00080000:1.0:1789049978.390303:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049978.392981:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.393097:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484288 00000100:00100000:1.0:1789049978.393119:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484288 00000100:00100000:1.0:1789049978.393184:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:1.0:1789049978.393196:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+7:8115:x1875954691484288:12345-192.168.206.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789049978.393330:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+7:8115:x1875954691484288:12345-192.168.206.1@tcp:40:mount.lustre.0 Request processed in 136us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.393339:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:2.0:1789049978.394355:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789049978.394371:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:0:x1875954691483904:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789049978.394399:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789049978.394466:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:0:x1875954691483904:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 100us (10788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.394473:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:0.0:1789049978.399859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.400089:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484416 00000100:00100000:1.0:1789049978.400103:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484416 00000100:00100000:1.0:1789049978.400166:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:1.0:1789049978.400177:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691484416:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049978.400412:0:6672:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0d9065b0-db35-40d7-baad-6d6fd77aa842@192.168.206.1@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1789049978.400451:0:6672:0:(genops.c:1384:class_connect()) connect: client 0d9065b0-db35-40d7-baad-6d6fd77aa842, cookie 0x9df728c939b78b0e 00002000:00100000:1.0:1789049978.400465:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d9065b0-db35-40d7-baad-6d6fd77aa842/ffff950605767800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049978.400494:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049978.400765:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049978.400800:0:6672:0:(import.c:65:import_set_state_nolock()) ffff950605762800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049978.400887:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2346:x1875954691484416:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 710us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049978.400896:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:1.0:1789049978.408190:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049978.408297:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049978.408597:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484672 00000100:00100000:2.0:1789049978.408620:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484672 00000100:00100000:0.0:1789049978.408728:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:0.0:1789049978.408746:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:8115:x1875954691484672:12345-192.168.206.1@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789049978.408840:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484544 00000100:00100000:3.0:1789049978.408846:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484544 00000004:00200000:0.0:1789049978.408850:0:5821:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789049978.408880:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789049978.408885:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875954691484544:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789049978.408913:0:8215:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0d9065b0-db35-40d7-baad-6d6fd77aa842@192.168.206.1@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:0.0:1789049978.408942:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:8115:x1875954691484672:12345-192.168.206.1@tcp:33:mount.lustre.0 Request processed in 204us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049978.408950:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000020:00000080:2.0:1789049978.409995:0:8215:0:(genops.c:1384:class_connect()) connect: client 0d9065b0-db35-40d7-baad-6d6fd77aa842, cookie 0x9df728c939b78b15 00002000:00100000:2.0:1789049978.410016:0:8215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0d9065b0-db35-40d7-baad-6d6fd77aa842/ffff95073c5d1800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789049978.410032:0:8215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789049978.410865:0:8215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789049978.410925:0:8215:0:(import.c:65:import_set_state_nolock()) ffff950720637800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049978.411011:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2346:x1875954691484544:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 2123us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049978.411023:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000001:00100000:2.0:1789049978.567933:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00000001:00100000:2.0:1789049978.581365:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00010000:00010000:3.0:1789049979.019396:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049980.043310:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049980.555614:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049980.555647:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704098304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049980.555719:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049980.555806:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098304 00000100:00100000:3.0:1789049980.555815:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098304 00000100:00100000:3.0:1789049980.555881:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049980.555894:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704098304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049980.555930:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049980.555984:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704098304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049980.555992:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789049980.556019:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049980.556450:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cb100 x1875954704098304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049980.556473:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704098304:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789049980.648307:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00010000:00010000:2.0:1789049981.070299:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049982.091524:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049982.604691:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704098560:0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.604786:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.604849:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704099072:0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.604878:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.604922:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049982.604928:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704098688:0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.604953:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049982.604993:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098560 00000100:00100000:3.0:1789049982.605004:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098560 00000100:00100000:3.0:1789049982.605064:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098688 00000100:00100000:3.0:1789049982.605068:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098688 00000100:00100000:3.0:1789049982.605099:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049982.605110:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.605169:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704098560:12345-0@lo:400:kworker.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049982.605178:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049982.605219:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789049982.605225:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.605254:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704098688:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049982.605260:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789049982.605285:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049982.605421:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704098816:0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605455:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.605478:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789049982.605484:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704098432:0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605511:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.605533:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704098944:0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605554:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049982.605581:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098944 00000100:00100000:2.0:1789049982.605585:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098944 00000100:00100000:2.0:1789049982.605617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789049982.605623:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704098944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605657:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704098944:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.605663:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789049982.605682:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099072 00000100:00100000:2.0:1789049982.605685:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099072 00000100:00100000:2.0:1789049982.605713:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098816 00000100:00100000:2.0:1789049982.605716:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098816 00000100:00100000:2.0:1789049982.605737:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049982.605744:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704099072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605809:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704099072:12345-0@lo:400:kworker.0 Request processed in 66us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.605816:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049982.605827:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049982.605833:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704098816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605862:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704098816:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.605868:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049982.605890:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704098432 00000100:00100000:2.0:1789049982.605894:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704098432 00000100:00100000:2.0:1789049982.605920:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789049982.605926:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704098432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.605956:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704098432:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049982.605963:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789049982.605999:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704098688:0@lo:400:kworker.0 00000100:00080000:2.0:1789049982.606003:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049982.606010:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049982.606024:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049982.606049:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704098432:0@lo:400:kworker.0 00000100:00100000:2.0:1789049982.606064:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704098944:0@lo:400:kworker.0 00010000:00080000:2.0:1789049982.606075:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7cad80 x1875954704098816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049982.606087:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704098816:0@lo:400:kworker.0 00000100:00100000:3.0:1789049982.606135:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704098560:0@lo:400:kworker.0 00010000:00080000:3.0:1789049982.606155:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7ca680 x1875954704099072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049982.606167:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704099072:0@lo:400:kworker.0 00000001:02000400:3.0:1789049982.733113:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789049983.115401:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049983.115526:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704099200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049983.115630:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049983.115995:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099200 00000100:00100000:3.0:1789049983.116006:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099200 00000100:00100000:3.0:1789049983.116100:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049983.116111:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704099200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049983.116156:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049983.116244:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704099200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049983.116263:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789049983.116878:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17c000 x1875954704099200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049983.116915:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704099200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049983.690849:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049983.690938:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049983.690981:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049983.691034:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049983.691093:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485184 00000100:00100000:0.0:1789049983.691108:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485184 00000100:00100000:0.0:1789049983.691194:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:0.0:1789049983.691238:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485184:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049983.691644:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485184:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 328us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049983.691666:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:1.0:1789049983.691731:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049983.691768:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484800 00000100:00100000:1.0:1789049983.691778:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484800 00000100:00100000:1.0:1789049983.691823:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 216 00000100:00100000:1.0:1789049983.691833:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2350:x1875954691484800:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789049983.691888:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2350:x1875954691484800:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 56us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049983.691896:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 216 00000100:00080000:2.0:1789049983.691930:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049983.691949:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485312 00000100:00100000:2.0:1789049983.691955:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485312 00000100:00100000:3.0:1789049983.692072:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691484928 00000100:00100000:3.0:1789049983.692079:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691484928 00000100:00100000:3.0:1789049983.692117:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485056 00000100:00100000:3.0:1789049983.692119:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485056 00000100:00100000:3.0:1789049983.692137:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:3.0:1789049983.692144:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691484928:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049983.692274:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691484928:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 130us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049983.692282:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:3.0:1789049983.692299:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:3.0:1789049983.692307:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485056:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049983.692414:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00080000:1.0:1789049983.692937:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049983.692943:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049983.694064:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485312:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049983.694468:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485056:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 2153us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049983.694479:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:2.0:1789049983.697734:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691485312:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 5296us (5992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049983.697751:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00010000:00010000:2.0:1789049984.141319:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049985.171991:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049985.677103:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704099328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049985.677169:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049985.677321:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099328 00000100:00100000:3.0:1789049985.677329:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099328 00000100:00100000:3.0:1789049985.677386:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049985.677396:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704099328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049985.677429:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049985.677476:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704099328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049985.677496:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789049985.677534:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1a7480 x1875954704099328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049985.677552:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704099328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049985.677836:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789049986.187697:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049987.211836:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049987.726301:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704099456:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726369:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726554:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704099968:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726583:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726611:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049987.726617:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704099840:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726642:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726673:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704099584:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726694:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726710:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704100096:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726735:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726752:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049987.726757:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704099712:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726774:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049987.726803:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099968 00000100:00100000:3.0:1789049987.726810:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099968 00000100:00100000:3.0:1789049987.726855:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099584 00000100:00100000:3.0:1789049987.726858:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099584 00000100:00100000:3.0:1789049987.726870:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099712 00000100:00100000:3.0:1789049987.726872:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099712 00000100:00100000:3.0:1789049987.726886:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789049987.726901:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.726952:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704099968:12345-0@lo:400:kworker.0 Request processed in 52us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.726978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789049987.727003:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789049987.727009:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727049:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704099584:12345-0@lo:400:kworker.0 Request processed in 40us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.727054:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789049987.727065:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049987.727072:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704099712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727100:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704099712:12345-0@lo:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.727105:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789049987.727186:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099456 00000100:00100000:2.0:1789049987.727191:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099456 00000100:00100000:3.0:1789049987.727217:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704099840 00000100:00100000:3.0:1789049987.727221:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704099840 00000100:00100000:2.0:1789049987.727243:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789049987.727245:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100096 00000100:00100000:3.0:1789049987.727247:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100096 00000100:00100000:2.0:1789049987.727249:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727264:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049987.727269:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704099840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049987.727282:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704099456:12345-0@lo:400:kworker.0 Request processed in 33us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049987.727287:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789049987.727295:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704099840:12345-0@lo:400:kworker.0 Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.727300:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049987.727310:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789049987.727315:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727340:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704100096:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049987.727353:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789049987.727377:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049987.727381:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049987.727383:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049987.727498:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704099712:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727508:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704099584:0@lo:400:kworker.0 00010000:00080000:3.0:1789049987.727519:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f2a00 x1875954704100096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049987.727534:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704100096:0@lo:400:kworker.0 00010000:00080000:3.0:1789049987.727567:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073d0d3480 x1875954704099840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049987.727576:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704099840:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727584:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704099456:0@lo:400:kworker.0 00000100:00100000:3.0:1789049987.727676:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704099968:0@lo:400:kworker.0 00010000:00010000:0.0:1789049988.236378:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049988.236829:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704100224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049988.236891:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049988.237092:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100224 00000100:00100000:0.0:1789049988.237100:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100224 00000100:00100000:0.0:1789049988.237156:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049988.237167:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704100224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049988.237712:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049988.238094:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704100224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 927us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.238103:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789049988.238165:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f2a00 x1875954704100224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049988.239823:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704100224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049988.814834:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049988.814897:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049988.815003:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049988.815037:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789049988.815062:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049988.815112:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485568 00000100:00100000:3.0:1789049988.815122:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485568 00000100:00100000:3.0:1789049988.815173:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485696 00000100:00100000:3.0:1789049988.815177:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485696 00000100:00100000:3.0:1789049988.815237:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789049988.815248:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691485568:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049988.815323:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691485568:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 77us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049988.815330:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789049988.815355:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:3.0:1789049988.815362:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485696:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049988.815390:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485696:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049988.815396:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00080000:3.0:1789049988.815412:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049988.815675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485440 00000100:00100000:0.0:1789049988.815680:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485440 00000100:00100000:0.0:1789049988.815721:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 218 00000100:00100000:0.0:1789049988.815728:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691485440:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049988.815760:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691485440:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 33us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.815767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 218 00000100:00100000:2.0:1789049988.815903:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485824 00000100:00100000:2.0:1789049988.815908:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485824 00000100:00100000:0.0:1789049988.815931:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691485952 00000100:00100000:0.0:1789049988.815937:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691485952 00000100:00100000:0.0:1789049988.815988:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:0.0:1789049988.815997:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485952:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049988.816024:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485952:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 29us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.816031:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:0.0:1789049988.816087:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:0.0:1789049988.816102:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485824:12345-192.168.206.1@tcp:400:kworker.0 00000100:00080000:2.0:1789049988.816106:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049988.816112:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049988.816132:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691485824:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 38us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049988.818612:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00010000:00010000:2.0:1789049989.260093:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049990.284097:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049990.800091:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049990.800125:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704100352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049990.800186:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049990.800300:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100352 00000100:00100000:3.0:1789049990.800307:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100352 00000100:00100000:3.0:1789049990.800356:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789049990.800365:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704100352:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789049990.800435:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789049990.800635:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049990.800682:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704100352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049990.800689:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789049990.800725:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f6300 x1875954704100352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049990.800743:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704100352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049991.308436:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049992.332278:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049992.843467:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704100480:0@lo:400:kworker.0 00000100:00100000:1.0:1789049992.843573:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.843756:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704100864:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.843794:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.843864:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049992.843871:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704100992:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.843915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.843953:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704100608:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.843989:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.844007:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704101120:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844027:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.844051:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049992.844056:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704100736:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844077:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049992.844109:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100864 00000100:00100000:3.0:1789049992.844119:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100864 00000100:00100000:3.0:1789049992.844175:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101120 00000100:00100000:3.0:1789049992.844178:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101120 00000100:00100000:3.0:1789049992.844224:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049992.844235:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704100864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844292:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704100864:12345-0@lo:400:kworker.0 Request processed in 59us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.844300:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049992.844318:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049992.844325:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704101120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844356:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704101120:12345-0@lo:400:kworker.0 Request processed in 32us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.844362:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049992.844378:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100992 00000100:00100000:3.0:1789049992.844381:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100992 00000100:00100000:3.0:1789049992.844407:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100608 00000100:00100000:3.0:1789049992.844410:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100608 00000100:00100000:3.0:1789049992.844420:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100736 00000100:00100000:3.0:1789049992.844429:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100736 00000100:00100000:3.0:1789049992.844447:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049992.844452:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844483:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704100992:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.844489:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049992.844502:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049992.844507:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844546:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704100608:12345-0@lo:400:kworker.0 Request processed in 38us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.844552:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049992.844563:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789049992.844569:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844593:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704100736:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049992.844599:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789049992.844627:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049992.844633:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049992.844635:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049992.844736:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704100736:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844747:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704100608:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.844760:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f3800 x1875954704101120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.844770:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704101120:0@lo:400:kworker.0 00000100:00100000:3.0:1789049992.844802:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704100992:0@lo:400:kworker.0 00010000:00080000:3.0:1789049992.844823:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f0380 x1875954704100864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049992.844833:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704100864:0@lo:400:kworker.0 00000100:00100000:2.0:1789049992.848395:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704100480 00000100:00100000:2.0:1789049992.848412:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704100480 00000100:00100000:2.0:1789049992.848474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789049992.848483:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704100480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049992.848601:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704100480:12345-0@lo:400:kworker.0 Request processed in 119us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049992.848608:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789049992.848719:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704100480:0@lo:400:kworker.0 00000100:00100000:3.0:1789049993.355762:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049993.355789:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049993.355875:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049993.355910:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049993.355962:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101248 00000100:00100000:3.0:1789049993.355971:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101248 00000100:00100000:3.0:1789049993.356029:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789049993.356039:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704101248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049993.356081:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049993.356136:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704101248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049993.356145:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789049993.356172:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f0380 x1875954704101248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049993.356194:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049993.930931:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049993.930999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049993.931037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049993.931064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049993.931090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789049993.931125:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486592 00000100:00100000:3.0:1789049993.931137:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486592 00000100:00100000:3.0:1789049993.931232:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486464 00000100:00100000:3.0:1789049993.931236:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486464 00000100:00100000:3.0:1789049993.931278:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:3.0:1789049993.931291:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486592:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049993.931376:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486592:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049993.931401:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:3.0:1789049993.931420:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:3.0:1789049993.931427:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486464:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049993.931468:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486464:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 42us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049993.931474:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:3.0:1789049993.931498:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486336 00000100:00100000:3.0:1789049993.931502:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486336 00000100:00100000:3.0:1789049993.931539:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486208 00000100:00100000:3.0:1789049993.931542:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486208 00000100:00100000:3.0:1789049993.931563:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:3.0:1789049993.931570:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486336:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049993.931598:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691486336:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049993.931604:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:3.0:1789049993.931615:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:3.0:1789049993.931620:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691486208:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049993.931661:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691486208:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 40us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049993.931667:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00080000:3.0:1789049993.931688:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049993.931693:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049993.931695:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049993.931931:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486080 00000100:00100000:2.0:1789049993.931937:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486080 00000100:00100000:2.0:1789049993.931981:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 220 00000100:00100000:2.0:1789049993.931989:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691486080:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789049993.932023:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691486080:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 35us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049993.932029:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 220 00010000:00010000:0.0:1789049994.381547:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049995.403417:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049995.917668:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049995.917755:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049995.917877:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101376 00000100:00100000:2.0:1789049995.917885:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101376 00000100:00100000:2.0:1789049995.917955:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789049995.917965:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704101376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049995.918004:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049995.918048:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704101376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049995.918055:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789049995.918378:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789049995.918407:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c1b5c00 x1875954704101376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049995.918425:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704101376:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789049996.088780:0:11007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789049996.427585:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049997.453737:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049997.964430:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704101504:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.964498:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.964548:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101504 00000100:00100000:3.0:1789049997.964557:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101504 00000100:00100000:3.0:1789049997.964614:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789049997.964624:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704101504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.964702:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704101504:12345-0@lo:400:kworker.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049997.964709:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789049997.964760:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704101504:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.964895:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704101632:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.964926:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.965000:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101632 00000100:00100000:2.0:1789049997.965005:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101632 00000100:00100000:2.0:1789049997.965040:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049997.965048:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.966189:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704101632:12345-0@lo:400:kworker.0 Request processed in 1138us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.966215:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049997.966249:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704101760:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.966287:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.966313:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704101632:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.966414:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101760 00000100:00100000:3.0:1789049997.966420:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101760 00000100:00100000:3.0:1789049997.966470:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789049997.966480:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704101760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.966613:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704101760:12345-0@lo:400:kworker.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.966714:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704101760:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.966753:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789049997.966778:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049997.972002:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049997.972024:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704102144:0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.972104:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704101888:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.972292:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049997.972295:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.972332:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704102016:0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.972361:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049997.972396:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102016 00000100:00100000:2.0:1789049997.972404:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102016 00000100:00100000:1.0:1789049997.972414:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102144 00000100:00100000:1.0:1789049997.972420:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102144 00000100:00100000:3.0:1789049997.972434:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704101888 00000100:00100000:3.0:1789049997.972441:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704101888 00000100:00100000:2.0:1789049997.972472:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049997.972481:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704102016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049997.972529:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704102016:12345-0@lo:400:kworker.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049997.972536:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049997.972580:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704102016:0@lo:400:kworker.0 00000100:00100000:1.0:1789049997.972774:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049997.972783:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704102144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.972918:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789049997.972926:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704101888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049997.972977:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704101888:12345-0@lo:400:kworker.0 Request processed in 51us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049997.972984:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789049997.973090:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049997.973101:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049997.973103:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789049997.973139:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950702d7f480 x1875954704101888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049997.973151:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704101888:0@lo:400:kworker.0 00000100:00100000:1.0:1789049997.973249:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704102144:12345-0@lo:400:kworker.0 Request processed in 465us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049997.973257:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789049997.973577:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950702d7d880 x1875954704102144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049997.973588:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704102144:0@lo:400:kworker.0 00000100:00100000:2.0:1789049998.475941:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049998.476009:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049998.476176:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102272 00000100:00100000:3.0:1789049998.476183:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102272 00000100:00100000:3.0:1789049998.476254:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789049998.476265:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049998.476299:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049998.476365:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049998.476373:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789049998.476426:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1789049998.476491:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f1180 x1875954704102272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049998.476510:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704102272:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1789049998.857092:0:11155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff842557b0 20000000:00000080:0.0:1789049998.857109:0:11155:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950737b6bc00 uarg=0000000000000000 20000000:01000000:0.0:1789049998.857143:0:11155:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789049998.857149:0:11155:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789049998.857154:0:11155:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789049998.857848:0:11156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789049998.858009:0:11155:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789049998.865615:0:11155:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789049998.865646:0:11155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865667:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865689:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865696:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865703:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865710:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865718:0:11155:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865756:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865770:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 12 pid: 5811 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.865783:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102400:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789049998.865922:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.865939:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 18 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.865948:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102528:0@lo:104: 00000100:00100000:0.0:1789049998.865993:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049998.866105:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.866114:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 18 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.866121:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102656:0@lo:104: 00000100:00100000:0.0:1789049998.866142:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049998.866733:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.866742:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 18 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.866751:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102784:0@lo:104: 00000100:00100000:0.0:1789049998.866774:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049998.867987:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102528 00000100:00100000:3.0:1789049998.867998:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102528 00000100:00100000:1.0:1789049998.868126:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102656 00000100:00100000:1.0:1789049998.868130:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102656 00000100:00100000:1.0:1789049998.868166:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049998.868175:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:11155:x1875954704102528:12345-0@lo:104: 00010000:00010000:1.0:1789049998.868190:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868264:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789049998.868270:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:11155:x1875954704102528:12345-0@lo:104: Request processed in 96us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049998.868277:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049998.868303:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049998.868308:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11155:x1875954704102656:12345-0@lo:104: 00010000:00010000:1.0:1789049998.868315:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868344:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789049998.868349:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11155:x1875954704102656:12345-0@lo:104: Request processed in 41us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049998.868354:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789049998.868370:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049998.868375:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868383:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049998.868386:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868395:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049998.868403:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049998.868408:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049998.868569:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868577:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049998.868596:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868612:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701489000/0x9df728c939b78ae4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78aeb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868624:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049998.868627:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868633:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789049998.868636:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868642:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049998.868647:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049998.868651:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789049998.868663:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868668:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049998.868673:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868679:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b78ad6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78add expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.868688:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049998.868694:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049998.868696:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049998.868703:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049998.868716:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704102912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049998.868752:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049998.868777:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049998.868783:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704103040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049998.868803:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049998.868833:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102912 00000100:00100000:1.0:1789049998.868837:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102912 00010000:00010000:1.0:1789049998.868855:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 19 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049998.868876:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103040 00000100:00100000:1.0:1789049998.868879:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103040 00010000:00010000:1.0:1789049998.868890:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 20 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049998.868900:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789049998.868906:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+20:3284:x1875954704102912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049998.868915:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049998.868920:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 20 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.869127:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.869139:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.869149:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704103168:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789049998.869384:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704102784 00000100:00100000:2.0:1789049998.869389:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704102784 00000100:00100000:2.0:1789049998.869413:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049998.869420:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11155:x1875954704102784:12345-0@lo:104: 00010000:00010000:2.0:1789049998.869428:0:6686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869462:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049998.869467:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11155:x1875954704102784:12345-0@lo:104: Request processed in 48us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049998.869473:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789049998.869486:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049998.869491:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869551:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789049998.869555:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869574:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049998.869581:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049998.869586:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049998.869604:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869609:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049998.869624:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869631:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700031a00/0x9df728c939b78ac8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78acf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.869645:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049998.869646:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049998.869648:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049998.869654:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049998.869662:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704103296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049998.869684:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049998.869756:0:11155:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c15780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049998.869777:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102528:0@lo:104: 00000100:00100000:0.0:1789049998.869786:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102656:0@lo:104: 00000100:00100000:0.0:1789049998.869793:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102784:0@lo:104: 00010000:00010000:1.0:1789049998.869851:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 20 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.869863:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701488a00/0x9df728c939b78aeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78ae4 expref: 20 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.869886:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049998.869935:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704102912:12345-0@lo:103:ldlm_bl.0 Request processed in 1019us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049998.869942:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789049998.869975:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103296 00000100:00100000:1.0:1789049998.869979:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103296 00010000:00010000:1.0:1789049998.869991:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 19 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049998.870004:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049998.870011:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704103040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049998.870019:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049998.870023:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 19 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870030:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 19 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870039:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701489600/0x9df728c939b78add lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78ad6 expref: 19 pid: 5811 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870048:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049998.870069:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3284:x1875954704103040:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049998.870075:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049998.870088:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789049998.870093:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3283:x1875954704103296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049998.870108:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049998.870112:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 17 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870119:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 17 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870128:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701489200/0x9df728c939b78acf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78ac8 expref: 17 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049998.870136:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049998.870168:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3283:x1875954704103296:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049998.870173:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049998.870630:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704103040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049998.870648:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704102912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049998.870680:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704102400:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789049998.870761:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049998.870845:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704103296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049998.870890:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486720 00000100:00100000:0.0:1789049998.870895:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486720 00010000:00010000:0.0:1789049998.870915:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049998.870955:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:0.0:1789049998.870963:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691486720:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049998.870972:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049998.870976:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.870986:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.870997:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05f200/0x9df728c939b78b00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f768 expref: 13 pid: 5811 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049998.871006:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049998.871296:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:2348:x1875954691486720:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 332us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049998.871303:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:0.0:1789049998.871848:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789049998.871902:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486848 00000100:00100000:2.0:1789049998.871908:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486848 00010000:00010000:2.0:1789049998.871945:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049998.871990:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:2.0:1789049998.871998:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:2347:x1875954691486848:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049998.872009:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049998.872013:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872023:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 12 pid: 5812 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872036:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872044:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872058:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872065:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872072:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872078:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872084:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789049998.872089:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872102:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872111:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.872121:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049998.872158:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:2347:x1875954691486848:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 161us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049998.872166:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 29 00010000:00010000:1.0:1789049998.873694:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701488600/0x9df728c939b78ac1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f730 expref: 11 pid: 5812 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049998.873715:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875954704103168:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789049998.873751:0:11155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.873838:0:11155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.873845:0:11155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049998.873851:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331800/0x9df728c939b78b1c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049999.068110:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049999.068140:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049999.068228:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049999.068272:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487232 00000100:00100000:0.0:1789049999.068281:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487232 00000100:00100000:3.0:1789049999.068832:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691486976 00000100:00100000:3.0:1789049999.068837:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691486976 00000100:00100000:3.0:1789049999.068874:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487104 00000100:00100000:3.0:1789049999.068878:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487104 00000100:00100000:3.0:1789049999.068901:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:3.0:1789049999.068911:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691486976:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789049999.069015:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789049999.069027:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2346:x1875954691487232:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:0.0:1789049999.069050:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78b0e 00000100:00080000:0.0:1789049999.069059:0:6672:0:(import.c:65:import_set_state_nolock()) ffff950605762800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789049999.069096:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789049999.069139:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691486976:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 228us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049999.069149:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:3.0:1789049999.069168:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:3.0:1789049999.069176:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691487104:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789049999.069234:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691487104:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 59us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049999.069242:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00080000:3.0:1789049999.069267:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049999.069271:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049999.069320:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789049999.069652:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+2:2346:x1875954691487232:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 629us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049999.069660:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789049999.069671:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487360 00000100:00100000:0.0:1789049999.069676:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487360 00000100:00100000:0.0:1789049999.071734:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:0.0:1789049999.071751:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2346:x1875954691487360:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:0.0:1789049999.071781:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78b15 00000100:00080000:0.0:1789049999.071792:0:6672:0:(import.c:65:import_set_state_nolock()) ffff950720637800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789049999.071835:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789049999.072176:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+2:2346:x1875954691487360:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 431us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049999.072185:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00010000:00010000:0.0:1789049999.072228:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049999.072234:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789049999.074132:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789049999.499411:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050000.075814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050000.076194:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487488 00000100:00100000:2.0:1789050000.076223:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487488 00000100:00100000:2.0:1789050000.076265:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 222 00000100:00100000:2.0:1789050000.076274:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:5591:x1875954691487488:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050000.076289:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050000.076307:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f792 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.076343:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.076353:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.076362:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031800, rc 0) 00000100:00100000:2.0:1789050000.076427:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487488:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 141us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050000.076435:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 222 00000100:00100000:0.0:1789050000.088187:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050000.088487:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487616 00000100:00100000:3.0:1789050000.088497:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487616 00000100:00100000:3.0:1789050000.088546:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 223 00000100:00100000:3.0:1789050000.088556:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487616:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.088886:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487616:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 330us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.088893:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 223 00000100:00100000:0.0:1789050000.099809:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050000.101194:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487744 00000100:00100000:3.0:1789050000.101226:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487744 00000100:00100000:3.0:1789050000.101283:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 224 00000100:00100000:3.0:1789050000.101293:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487744:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.101519:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487744:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 226us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.101528:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 224 00000100:00100000:0.0:1789050000.107324:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050000.107416:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691487872 00000100:00100000:2.0:1789050000.107426:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691487872 00000100:00100000:2.0:1789050000.107472:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 225 00000100:00100000:2.0:1789050000.107483:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691487872:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050000.107508:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050000.107525:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f799 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.107551:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.107562:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.107570:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700030000, rc 0) 00000100:00100000:2.0:1789050000.107626:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691487872:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050000.107645:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 225 00000100:00100000:0.0:1789050000.115879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050000.116008:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488000 00000100:00100000:1.0:1789050000.116018:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488000 00000100:00100000:1.0:1789050000.116075:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 226 00000100:00100000:1.0:1789050000.116086:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691488000:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050000.116594:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691488000:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 508us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050000.116609:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 226 00000100:00100000:0.0:1789050000.125643:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050000.125900:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488128 00000100:00100000:3.0:1789050000.125909:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488128 00000100:00100000:3.0:1789050000.126000:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 227 00000100:00100000:3.0:1789050000.126010:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691488128:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.126306:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691488128:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 296us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.126314:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 227 10000000:01000000:0.0:1789050000.459749:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050000.459756:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95073d0e4000 from 7 10000000:01000000:0.0:1789050000.459761:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050000.459804:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.459816:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.459826:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050000.459850:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050000.459911:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050000.459968:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.460243:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103424 00000100:00100000:3.0:1789050000.460251:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103424 00000100:00100000:3.0:1789050000.460304:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789050000.460314:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704103424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050000.460325:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050000.460338:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78b31 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.460359:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.460368:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.460377:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0ee00, rc 0) 00000100:00100000:3.0:1789050000.460416:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.460423:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789050000.461899:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050000.461933:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.461944:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050000.462012:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050000.462056:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050000.462087:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.462327:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103552 00000100:00100000:3.0:1789050000.462334:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103552 00000100:00100000:3.0:1789050000.462367:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789050000.462375:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.462852:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 476us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.462869:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789050000.463447:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.463490:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.463537:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050000.463734:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050000.469063:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103680 00000100:00100000:0.0:1789050000.469088:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103680 00000100:00100000:0.0:1789050000.469191:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789050000.469227:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050000.469676:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 475us (6137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050000.469685:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789050000.469794:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050000.470401:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789050000.470733:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789050000.470757:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050000.470767:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.470778:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050000.470787:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050000.470790:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95071009a800 from 7 10000000:01000000:2.0:1789050000.470793:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050000.470826:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.470834:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.470844:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050000.470865:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.470932:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050000.476422:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.476672:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103808 00000100:00100000:3.0:1789050000.476684:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103808 00000100:00100000:3.0:1789050000.476789:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789050000.476800:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704103808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050000.476817:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050000.476993:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78b3f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.477022:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.477038:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.477047:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f800, rc 0) 00000100:00100000:3.0:1789050000.477115:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704103808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.477122:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789050000.478244:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050000.478265:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050000.478276:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050000.478345:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.478390:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050000.478431:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.478594:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704103936 00000100:00100000:3.0:1789050000.478601:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704103936 00000100:00100000:3.0:1789050000.478637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789050000.478644:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704103936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.479680:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704103936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1031us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.479690:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789050000.480001:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704103936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.480041:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.480190:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050000.480240:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.480253:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104064 00000100:00100000:3.0:1789050000.480266:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104064 00000100:00100000:3.0:1789050000.480297:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789050000.480305:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704104064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.480469:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704104064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050000.480476:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789050000.480979:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050000.481956:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789050000.487265:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789050000.487304:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050000.487315:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.487327:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050000.487337:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789050000.487340:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950707961800 from 7 10000000:01000000:3.0:1789050000.487343:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050000.487383:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.487391:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.487402:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050000.487425:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.487485:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050000.487590:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050000.490752:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104192 00000100:00100000:0.0:1789050000.490766:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104192 00000100:00100000:0.0:1789050000.490967:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789050000.490979:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704104192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050000.490995:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050000.491012:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78b4d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.491036:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.491047:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.491055:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331200, rc 0) 00000100:00100000:0.0:1789050000.491144:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704104192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050000.491151:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789050000.491637:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050000.491668:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050000.491677:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050000.491744:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.491780:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050000.500410:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050000.503621:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104320 00000100:00100000:2.0:1789050000.503636:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104320 00000100:00100000:2.0:1789050000.503695:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789050000.503705:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704104320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050000.504133:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704104320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (12351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050000.504140:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789050000.511376:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.511435:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050000.511504:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050000.511990:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070616bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050000.512011:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104448 00000100:00100000:3.0:1789050000.512017:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104448 00000100:00100000:0.0:1789050000.515037:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789050000.515060:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704104448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050000.515487:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704104448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 436us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050000.515503:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789050000.515618:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704104448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050000.516634:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789050000.516812:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789050000.517139:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050000.517151:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.517163:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050000.523438:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050001.037670:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704104576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050001.037735:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050001.040278:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104576 00000100:00100000:0.0:1789050001.040290:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104576 00000100:00100000:0.0:1789050001.040346:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050001.040357:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704104576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050001.040391:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050001.040456:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704104576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050001.040464:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789050001.040485:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050001.040518:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f1880 x1875954704104576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050001.040536:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704104576:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789050001.067400:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00000020:00000080:2.0:1789050001.067407:0:6698:0:(genops.c:885:class_export_put()) final put ffff950605767800/0d9065b0-db35-40d7-baad-6d6fd77aa842 00000020:00000080:3.0:1789050001.067471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950605767800/0d9065b0-db35-40d7-baad-6d6fd77aa842 for lustre-OST0000 00000020:00000080:3.0:1789050001.067518:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605762800 for lustre-OST0000 00010000:00010000:1.0:1789050001.547469:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050002.460441:0:11353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789050002.572279:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050003.083436:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704105088:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.083513:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.083585:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050003.083593:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704104960:0@lo:400:kworker.0 00000100:00100000:0.0:1789050003.083620:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050003.083700:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704104832:0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.083730:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050003.083756:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704105344:0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.083776:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050003.083823:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789050003.083829:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704104704:0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.083856:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050003.083879:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704105216:0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.083913:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050003.083942:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105088 00000100:00100000:2.0:1789050003.083948:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104704 00000100:00100000:3.0:1789050003.083951:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105088 00000100:00100000:2.0:1789050003.083954:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104704 00000100:00100000:2.0:1789050003.083997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789050003.084001:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105344 00000100:00100000:3.0:1789050003.084005:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105344 00000100:00100000:2.0:1789050003.084010:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704104704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084026:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050003.084036:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704105088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.084064:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704104704:12345-0@lo:400:kworker.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050003.084072:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789050003.084088:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704105088:12345-0@lo:400:kworker.0 Request processed in 54us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.084106:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789050003.084120:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789050003.084124:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704104704:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084129:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084167:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704105344:12345-0@lo:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00080000:2.0:1789050003.084173:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050003.084174:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789050003.084180:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050003.084194:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104960 00000100:00100000:2.0:1789050003.084219:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104960 00000100:00100000:2.0:1789050003.084260:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704104832 00000100:00100000:2.0:1789050003.084270:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704104832 00000100:00100000:2.0:1789050003.084290:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105216 00000100:00100000:2.0:1789050003.084294:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105216 00000100:00100000:3.0:1789050003.084302:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789050003.084313:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704104960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.084318:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789050003.084329:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084351:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704104960:12345-0@lo:400:kworker.0 Request processed in 41us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.084359:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789050003.084374:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704104832:12345-0@lo:400:kworker.0 Request processed in 46us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050003.084379:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789050003.084387:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789050003.084391:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084426:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704105216:12345-0@lo:400:kworker.0 Request processed in 38us (523us total) trans 0 rc 0/0 00000100:00080000:2.0:1789050003.084428:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050003.084435:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789050003.084451:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704105216:0@lo:400:kworker.0 00000100:00100000:2.0:1789050003.084465:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704104832:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.084475:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704104960:0@lo:400:kworker.0 00010000:00080000:2.0:1789050003.084484:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033daa00 x1875954704105344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050003.084496:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704105344:0@lo:400:kworker.0 00010000:00080000:3.0:1789050003.084563:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033dbb80 x1875954704105088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050003.084572:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704105088:0@lo:400:kworker.0 00000100:00100000:3.0:1789050003.595456:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704105472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050003.595854:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050003.597749:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050003.599313:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105472 00000100:00100000:0.0:1789050003.599326:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105472 00000100:00100000:0.0:1789050003.599387:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789050003.599397:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704105472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050003.599433:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050003.599507:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704105472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050003.599514:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789050003.599715:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f5500 x1875954704105472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050003.599746:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704105472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050004.169892:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050004.169940:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050004.169978:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050004.170006:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488256 00000100:00100000:3.0:1789050004.170015:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488256 00000100:00100000:3.0:1789050004.170059:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 238 00000100:00100000:3.0:1789050004.170068:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691488256:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050004.170359:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691488256:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 291us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050004.170368:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 238 00000100:00100000:3.0:1789050004.170398:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488384 00000100:00100000:3.0:1789050004.170402:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488384 00000100:00100000:3.0:1789050004.170434:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488512 00000100:00100000:3.0:1789050004.170437:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488512 00000100:00100000:3.0:1789050004.170459:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:3.0:1789050004.170466:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691488384:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050004.170616:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691488384:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 150us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050004.170624:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:3.0:1789050004.170636:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:3.0:1789050004.170643:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691488512:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050004.170663:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691488512:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 21us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050004.170669:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00080000:3.0:1789050004.170686:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789050004.180807:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00000020:00000080:2.0:1789050004.180815:0:7634:0:(genops.c:885:class_export_put()) final put ffff95073c5d1800/0d9065b0-db35-40d7-baad-6d6fd77aa842 00000020:00000080:1.0:1789050004.180876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c5d1800/0d9065b0-db35-40d7-baad-6d6fd77aa842 for lustre-OST0001 00000020:00000080:1.0:1789050004.180933:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950720637800 for lustre-OST0001 00010000:00010000:1.0:1789050004.619499:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050005.536632:0:11454:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:20:05 (1789050005) === 00010000:00010000:3.0:1789050005.643777:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050005.872289:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050005.872338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050005.872410:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488768 00000100:00100000:0.0:1789050005.872419:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488768 00000100:00100000:0.0:1789050005.872478:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:0.0:1789050005.872490:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2c118c85-b079-4c51-87ec-099389ee7be3+6:9666:x1875954691488768:12345-192.168.206.1@tcp:700:mkdir.0 00000100:00100000:3.0:1789050005.872496:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691488640 00000100:00100000:3.0:1789050005.872516:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691488640 00000100:00100000:3.0:1789050005.872563:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:3.0:1789050005.872573:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691488640:12345-192.168.206.1@tcp:41:mkdir.0 00000100:00100000:0.0:1789050005.872581:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2c118c85-b079-4c51-87ec-099389ee7be3+7:9666:x1875954691488768:12345-192.168.206.1@tcp:700:mkdir.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050005.872588:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000004:00000024:3.0:1789050005.872607:0:8158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050005.872664:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691488640:12345-192.168.206.1@tcp:41:mkdir.0 Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050005.872672:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050005.883045:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050005.883295:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489024 00000100:00100000:3.0:1789050005.883305:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489024 00000100:00100000:3.0:1789050005.883362:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050005.883374:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:9666:x1875954691489024:12345-192.168.206.1@tcp:36:mkdir.0 00010000:00010000:3.0:1789050005.883428:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050005.883458:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78a3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f71b expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883492:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52100) 00010000:00010000:3.0:1789050005.883503:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050005.883798:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883811:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883821:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883832:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883850:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.883857:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050005.885000:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789050005.885014:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885022:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885029:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885034:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050005.885038:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885044:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885055:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050005.885058:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050005.885062:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.885067:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050005.885093:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007134fed1 reply state 0000000074231b03 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050005.885101:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050005.885194:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:9666:x1875954691489024:12345-192.168.206.1@tcp:36:mkdir.0 Request processed in 1821us (2157us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789050005.885231:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00010000:00010000:2.0:1789050005.889380:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889398:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889406:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889425:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050005.889430:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889438:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889455:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9507114dce00) 00010000:00010000:2.0:1789050005.889458:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050005.889462:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.889469:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78b62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050005.902751:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050005.903001:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489152 00000100:00100000:3.0:1789050005.903011:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489152 00000100:00100000:3.0:1789050005.903069:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:3.0:1789050005.903079:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:9668:x1875954691489152:12345-192.168.206.1@tcp:101:chmod.0 00010000:00010000:3.0:1789050005.903098:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050005.903117:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7a0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903179:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903192:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903310:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050005.903405:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050005.903409:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050005.903447:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903551:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a0 expref: 8 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903568:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a0 expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.903577:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050005.903580:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050005.903583:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488a00, rc 0) 00000100:00100000:3.0:1789050005.904000:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:9668:x1875954691489152:12345-192.168.206.1@tcp:101:chmod.0 Request processed in 920us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050005.904007:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050005.911139:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050005.911235:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489408 00000100:00100000:2.0:1789050005.911245:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489408 00000100:00100000:2.0:1789050005.911345:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050005.911356:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:9668:x1875954691489408:12345-192.168.206.1@tcp:36:chmod.0 00010000:00010000:2.0:1789050005.911404:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050005.911428:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78b70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a0 expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.911449:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050005.911471:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050005.911496:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.911508:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050005.911530:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050005.911963:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000093f65070 reply state 00000000db291965 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050005.911972:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789050005.911980:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789050005.912054:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:9668:x1875954691489408:12345-192.168.206.1@tcp:36:chmod.0 Request processed in 700us (924us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789050005.912061:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00010000:00010000:1.0:1789050005.916668:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916736:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916745:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916752:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050005.916756:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916763:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916781:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:1.0:1789050005.916784:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050005.916789:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.916795:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78b77 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050005.940354:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050005.940667:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489536 00000100:00100000:1.0:1789050005.940676:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489536 00000100:00100000:1.0:1789050005.940743:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:1.0:1789050005.940753:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:9669:x1875954691489536:12345-192.168.206.1@tcp:101:chown.0 00010000:00010000:1.0:1789050005.940775:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050005.940810:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7a7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.940869:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.940882:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.940904:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050005.940938:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789050005.940941:0:5818:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050005.940979:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.941002:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a7 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.941020:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a7 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.941029:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4600) 00010000:00010000:1.0:1789050005.941031:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050005.941034:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:1.0:1789050005.941092:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:9669:x1875954691489536:12345-192.168.206.1@tcp:101:chown.0 Request processed in 340us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050005.941099:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:0.0:1789050005.945050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050005.945535:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489664 00000100:00100000:3.0:1789050005.945544:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489664 00000100:00100000:3.0:1789050005.945595:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050005.945604:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:9669:x1875954691489664:12345-192.168.206.1@tcp:101:chown.0 00010000:00010000:3.0:1789050005.945621:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050005.945639:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7ae expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945860:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945874:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945884:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945922:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945930:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.945937:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946016:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946024:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946030:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050005.946057:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050005.946060:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050005.946077:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946089:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946096:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946102:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946116:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050005.946120:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946127:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946138:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4600) 00010000:00010000:3.0:1789050005.946140:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050005.946144:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946149:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946162:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946167:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946171:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946176:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050005.946178:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946307:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946326:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9507114dcf00) 00010000:00010000:3.0:1789050005.946328:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050005.946331:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946336:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946368:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ae expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946381:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ae expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050005.946387:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050005.946389:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050005.946391:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489c00, rc 0) 00000100:00100000:3.0:1789050005.946556:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:9669:x1875954691489664:12345-192.168.206.1@tcp:101:chown.0 Request processed in 953us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050005.946564:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:0.0:1789050005.950618:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050005.950797:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691489920 00000100:00100000:1.0:1789050005.950817:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691489920 00000100:00100000:1.0:1789050005.950907:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:1.0:1789050005.950917:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:9669:x1875954691489920:12345-192.168.206.1@tcp:36:chown.0 00010000:00010000:1.0:1789050005.950962:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050005.950984:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ae expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.951001:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9507114dce00) 00010000:00010000:1.0:1789050005.951010:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050005.951031:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.951042:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050005.951050:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050006.006156:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789050006.007403:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000073656b35 reply state 000000007ae94c7c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050006.007419:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789050006.007433:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789050006.007524:0:5818:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789050006.007550:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:9669:x1875954691489920:12345-192.168.206.1@tcp:36:chown.0 Request processed in 56631us (56936us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789050006.007558:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00010000:00010000:1.0:1789050006.007735:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007745:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007757:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007762:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050006.007767:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007789:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007815:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:1.0:1789050006.007818:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050006.007823:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.007829:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ba8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050006.029601:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.029731:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490048 00000100:00100000:2.0:1789050006.029741:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490048 00000100:00080000:3.0:1789050006.029804:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050006.029818:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:2.0:1789050006.029830:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:9670:x1875954691490048:12345-192.168.206.1@tcp:101:touch.500 00010000:00010000:2.0:1789050006.029852:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050006.029872:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7b5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050006.031440:0:5819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1495us 00010000:00010000:2.0:1789050006.045850:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.045871:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.045894:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.045910:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.045917:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.045924:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046238:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046248:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046255:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050006.046277:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050006.046280:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050006.046326:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046337:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046344:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046354:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046360:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.046364:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046371:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046382:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4600) 00010000:00010000:2.0:1789050006.046385:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050006.046391:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046397:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046407:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046413:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046428:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046433:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700031a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.046435:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046441:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046449:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050006.046451:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050006.046454:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046459:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046495:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7b5 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046511:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7b5 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.046517:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:2.0:1789050006.046519:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050006.046521:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031200, rc 0) 00000100:00100000:2.0:1789050006.046580:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:9670:x1875954691490048:12345-192.168.206.1@tcp:101:touch.500 Request processed in 16752us (16987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050006.046596:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:0.0:1789050006.053570:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.053920:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490304 00000100:00100000:3.0:1789050006.053929:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490304 00000100:00100000:3.0:1789050006.053981:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:3.0:1789050006.053991:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:9670:x1875954691490304:12345-192.168.206.1@tcp:101:touch.500 00010000:00010000:3.0:1789050006.054010:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050006.054026:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78bcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7bc expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055628:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055647:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055658:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055711:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055718:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.055724:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050006.056362:0:8158:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789050006.056579:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056590:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056598:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056626:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056642:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056649:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056655:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050006.056659:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056666:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056676:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:3.0:1789050006.056679:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050006.056683:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.056690:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b78bd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050006.056702:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000983d91e2 reply state 0000000054f0c8df transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050006.059831:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789050006.060782:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78bcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7bc expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.061077:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7bc expref: 9 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.061108:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9507114dc600) 00010000:00010000:3.0:1789050006.061112:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050006.061116:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489c00, rc 0) 00000100:00100000:3.0:1789050006.061258:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+10:9670:x1875954691490304:12345-192.168.206.1@tcp:101:touch.500 Request processed in 7266us (7693us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789050006.061268:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00010000:00010000:1.0:1789050006.065964:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.065980:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.065988:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.065994:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050006.065998:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.066006:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.066023:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9507114dcf00) 00010000:00010000:1.0:1789050006.066026:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050006.066031:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.066056:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78bd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050006.067711:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.068721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490560 00000100:00100000:3.0:1789050006.068732:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490560 00000100:00100000:2.0:1789050006.069274:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050006.069285:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:9670:x1875954691490560:12345-192.168.206.1@tcp:36:touch.500 00010000:00010000:2.0:1789050006.069335:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050006.069359:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7bc expref: 9 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.069376:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9507114dc600) 00010000:00010000:2.0:1789050006.069385:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050006.069429:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.069441:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.069450:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050006.069706:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006810c89a reply state 00000000c79244ac transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050006.069716:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050006.070014:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+10:9670:x1875954691490560:12345-192.168.206.1@tcp:36:touch.500 Request processed in 729us (2307us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789050006.070021:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00010000:00010000:2.0:1789050006.073177:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073233:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073254:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073261:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.073265:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073273:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073289:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050006.073293:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050006.073455:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.073473:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78bee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050006.076638:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.076704:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490688 00000100:00100000:2.0:1789050006.076712:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490688 00000100:00100000:2.0:1789050006.076836:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:2.0:1789050006.076847:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:9670:x1875954691490688:12345-192.168.206.1@tcp:101:touch.500 00010000:00010000:2.0:1789050006.076869:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050006.076899:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.076952:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7c3 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.076985:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7c3 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.077005:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050006.077008:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050006.077011:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031a00, rc 0) 00000100:00100000:2.0:1789050006.077066:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+10:9670:x1875954691490688:12345-192.168.206.1@tcp:101:touch.500 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050006.077072:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:1.0:1789050006.086781:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.087149:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490816 00000100:00100000:3.0:1789050006.087159:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490816 00000100:00100000:3.0:1789050006.087230:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:3.0:1789050006.087238:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875954691490816:12345-192.168.206.1@tcp:8:touch.500 00010000:00080000:3.0:1789050006.087266:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789050006.087298:0:6670:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78bfc 00002000:00100000:3.0:1789050006.087309:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2c118c85-b079-4c51-87ec-099389ee7be3/ffff95073c5d1800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789050006.087331:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789050006.087543:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789050006.087571:0:6670:0:(import.c:65:import_set_state_nolock()) ffff95073c5d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050006.088262:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691490816:12345-192.168.206.1@tcp:8:touch.500 Request processed in 1019us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050006.088270:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:1.0:1789050006.097919:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.098002:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691490944 00000100:00100000:3.0:1789050006.098011:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691490944 00000100:00100000:3.0:1789050006.098092:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:3.0:1789050006.098102:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:0:x1875954691490944:12345-192.168.206.1@tcp:2:touch.500 00000100:00080000:2.0:1789050006.098396:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050006.145167:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:0:x1875954691490944:12345-192.168.206.1@tcp:2:touch.500 Request processed in 47057us (47247us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789050006.145179:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000001:00080000:2.0:1789050006.145234:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1789050006.145243:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000100:00100000:0.0:1789050006.158512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.158750:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704105600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050006.158795:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050006.158866:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105600 00000100:00100000:3.0:1789050006.158873:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105600 00000100:00100000:3.0:1789050006.158935:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789050006.158944:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704105600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050006.158964:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050006.159003:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704105600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050006.159009:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789050006.159028:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789050006.159054:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507375f2300 x1875954704105600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050006.159071:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704105600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050006.160437:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691491200 00000100:00100000:2.0:1789050006.160450:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691491200 00000100:00100000:2.0:1789050006.160595:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050006.160605:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+10:9670:x1875954691491200:12345-192.168.206.1@tcp:35:touch.500 00000100:00100000:2.0:1789050006.160922:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:9670:x1875954691491200:12345-192.168.206.1@tcp:35:touch.500 Request processed in 317us (2428us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789050006.160930:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:1.0:1789050006.188707:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050006.188851:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691491328 00000100:00100000:0.0:1789050006.188860:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691491328 00000100:00100000:0.0:1789050006.189034:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:0.0:1789050006.189046:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+11:9671:x1875954691491328:12345-192.168.206.1@tcp:101:rm.0 00010000:00010000:0.0:1789050006.189069:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050006.189087:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7ca expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189150:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189164:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189177:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050006.189249:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789050006.189253:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050006.189288:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189315:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ca expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189333:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ca expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.189355:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:0.0:1789050006.189358:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050006.189362:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330800, rc 0) 00000100:00100000:0.0:1789050006.189619:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+12:9671:x1875954691491328:12345-192.168.206.1@tcp:101:rm.0 Request processed in 574us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050006.189627:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:1.0:1789050006.196539:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050006.197312:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691491584 00000100:00100000:3.0:1789050006.197323:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691491584 00000100:00100000:3.0:1789050006.197618:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:3.0:1789050006.197630:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+12:9671:x1875954691491584:12345-192.168.206.1@tcp:101:rm.0 00010000:00010000:3.0:1789050006.197649:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050006.197666:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78c11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7d1 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050006.197752:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789050006.198143:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78c11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7d1 expref: 14 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.198168:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4600) 00010000:00010000:3.0:1789050006.198171:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050006.198176:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b78c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7d1 expref: 14 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.198190:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489200, rc 0) 00000100:00100000:3.0:1789050006.198292:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+13:9671:x1875954691491584:12345-192.168.206.1@tcp:101:rm.0 Request processed in 664us (1834us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789050006.198299:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:3.0:1789050006.210431:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050006.210596:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691491712 00000100:00100000:0.0:1789050006.210605:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691491712 00000100:00100000:0.0:1789050006.210660:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:0.0:1789050006.210671:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+13:9671:x1875954691491712:12345-192.168.206.1@tcp:37:rm.0 00000100:00100000:0.0:1789050006.217399:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+13:9671:x1875954691491712:12345-192.168.206.1@tcp:37:rm.0 Request processed in 6720us (6968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050006.217412:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:1.0:1789050006.221344:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.221434:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691491968 00000100:00100000:2.0:1789050006.221453:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691491968 00000100:00100000:2.0:1789050006.221509:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789050006.221533:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:9671:x1875954691491968:12345-192.168.206.1@tcp:35:rm.0 00000100:00100000:2.0:1789050006.221750:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:9671:x1875954691491968:12345-192.168.206.1@tcp:35:rm.0 Request processed in 219us (425us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789050006.221758:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050006.225101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.225242:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691492224 00000100:00100000:2.0:1789050006.225251:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691492224 00000100:00100000:2.0:1789050006.225302:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050006.225312:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:9671:x1875954691492224:12345-192.168.206.1@tcp:101:rm.0 00010000:00010000:2.0:1789050006.225335:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050006.225352:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7d8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.225437:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78c26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.225451:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78c26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.225516:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78c26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050006.225530:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050006.225680:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7d8 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.225699:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78c26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7d8 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.225718:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:2.0:1789050006.225721:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050006.225723:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950700031600, rc 0) 00000100:00100000:2.0:1789050006.225783:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492224:12345-192.168.206.1@tcp:101:rm.0 Request processed in 471us (690us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789050006.225790:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:1.0:1789050006.231033:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.231115:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691492352 00000100:00100000:2.0:1789050006.231124:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691492352 00000100:00100000:2.0:1789050006.231181:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:2.0:1789050006.231190:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492352:12345-192.168.206.1@tcp:41:rm.0 00000004:00000024:2.0:1789050006.231269:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789050006.231343:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492352:12345-192.168.206.1@tcp:41:rm.0 Request processed in 153us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050006.231351:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:1.0:1789050006.236497:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050006.236587:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691492480 00000100:00100000:0.0:1789050006.236596:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691492480 00000100:00100000:0.0:1789050006.236653:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:0.0:1789050006.236663:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492480:12345-192.168.206.1@tcp:101:rm.0 00010000:00010000:0.0:1789050006.236683:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050006.236700:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7df expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236756:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236769:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236794:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236808:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236815:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236821:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236920:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236929:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236936:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050006.236960:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789050006.236963:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050006.236978:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236988:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.236995:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237010:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237016:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237022:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050006.237025:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237031:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237042:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:0.0:1789050006.237045:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050006.237049:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237055:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237068:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237073:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237079:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237083:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050006.237091:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237098:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237106:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff950714b52d00) 00010000:00010000:0.0:1789050006.237108:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050006.237111:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237117:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237145:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7df expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237157:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7df expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.237164:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050006.237166:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050006.237168:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331400, rc 0) 00000100:00100000:0.0:1789050006.237418:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+17:9671:x1875954691492480:12345-192.168.206.1@tcp:101:rm.0 Request processed in 755us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050006.237426:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:3.0:1789050006.243583:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.243667:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691492736 00000100:00100000:2.0:1789050006.243675:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691492736 00000100:00100000:2.0:1789050006.243734:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:2.0:1789050006.243743:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+17:9671:x1875954691492736:12345-192.168.206.1@tcp:36:rm.0 00010000:00010000:2.0:1789050006.243785:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789050006.243807:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b78c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7df expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243825:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700031a00/0x9df728c939b78bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7c3 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243851:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050006.243864:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ca expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243871:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:2.0:1789050006.243874:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050006.243907:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243918:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243926:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243938:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243945:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.243952:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244046:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244054:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244068:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050006.244739:0:8158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789050006.244750:0:8158:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242232549415ns, next at 243232546812ns, rc = 0 00010000:00010000:2.0:1789050006.244809:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244820:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244828:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244836:0:8158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244841:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244847:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244872:0:8158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050006.244900:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244906:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244912:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244924:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.244928:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.244928:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050006.244934:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244936:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.244946:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1000) 00010000:00010000:2.0:1789050006.244949:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789050006.244952:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245629:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51400/0x9df728c939b78c5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245743:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245750:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245756:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245762:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.245766:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245772:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245798:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:2.0:1789050006.245800:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050006.245804:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.245810:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030200/0x9df728c939b78c50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050006.245821:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000040e5b94e reply state 00000000b5126c79 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050006.245829:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050006.245974:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492736:12345-192.168.206.1@tcp:36:rm.0 Request processed in 2228us (2396us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789050006.245982:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 30 00010000:00010000:0.0:1789050006.249809:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050006.249821:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.249837:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.249856:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95072c9b1000) 00010000:00010000:0.0:1789050006.249859:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789050006.249863:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.249870:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b78c65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.249915:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050006.249918:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050006.249920:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050006.252579:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252595:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252603:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252608:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050006.252613:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252620:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252662:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050006.252666:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050006.252671:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050006.252677:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700030400/0x9df728c939b78c57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050006.256351:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050006.256492:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691492992 00000100:00100000:2.0:1789050006.256502:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691492992 00000100:00100000:2.0:1789050006.256557:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:2.0:1789050006.256568:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:9671:x1875954691492992:12345-192.168.206.1@tcp:35:rm.0 00000100:00100000:2.0:1789050006.256807:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691492992:12345-192.168.206.1@tcp:35:rm.0 Request processed in 239us (465us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789050006.256815:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:2.0:1789050006.261564:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050006.262735:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493248 00000100:00100000:0.0:1789050006.262745:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493248 00000100:00100000:0.0:1789050006.262806:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:0.0:1789050006.262816:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+16:9671:x1875954691493248:12345-192.168.206.1@tcp:36:rm.0 00010000:00010000:0.0:1789050006.262865:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789050006.262902:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700031600/0x9df728c939b78c26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7d8 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.262924:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950700031200/0x9df728c939b78bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7b5 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.262951:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:0.0:1789050006.262967:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78b85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7a7 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.262976:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4600) 00010000:00010000:0.0:1789050006.262983:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050006.263004:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263015:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263029:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263040:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263046:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263052:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263305:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263314:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.263330:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050006.264921:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789050006.264942:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264951:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264957:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264962:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050006.264966:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264972:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264984:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff950714b52700) 00010000:00010000:0.0:1789050006.264986:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789050006.264990:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.264995:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78c7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265017:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265023:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265035:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265040:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050006.265043:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265048:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265824:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52d00) 00010000:00010000:0.0:1789050006.265829:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050006.265832:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050006.265839:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78c6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050006.265855:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005b420e40 reply state 00000000e41a6bad transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050006.265863:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050006.266037:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:9671:x1875954691493248:12345-192.168.206.1@tcp:36:rm.0 Request processed in 3219us (4478us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789050006.266047:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00010000:00010000:2.0:1789050006.269298:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269314:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269348:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269354:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050006.269359:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269367:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269383:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff950714b52800) 00010000:00010000:2.0:1789050006.269386:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050006.269390:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050006.269396:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78c73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050006.670238:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050007.693639:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050008.204526:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704105984:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.204578:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704105856:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.204591:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.204623:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.204650:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050008.204651:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704106368:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.204659:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704106112:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.204710:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.204724:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105984 00000100:00100000:3.0:1789050008.204732:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105984 00000100:00100000:0.0:1789050008.204747:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789050008.204755:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704105728:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.204784:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105856 00000100:00100000:0.0:1789050008.204789:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050008.204790:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105856 00000100:00100000:0.0:1789050008.204823:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704106240:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.204825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789050008.204839:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.204853:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.204887:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106240 00000100:00100000:0.0:1789050008.204892:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106240 00000100:00100000:3.0:1789050008.204906:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704105984:12345-0@lo:400:kworker.0 Request processed in 68us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.204916:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789050008.204922:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789050008.204930:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.204937:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789050008.204947:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704106240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.204971:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704105856:12345-0@lo:400:kworker.0 Request processed in 40us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050008.204978:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789050008.204990:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704106240:12345-0@lo:400:kworker.0 Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.204999:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789050008.205000:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704105728 00000100:00100000:0.0:1789050008.205005:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704105728 00000100:00080000:3.0:1789050008.205032:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050008.205040:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789050008.205049:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205061:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050008.205090:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704105728:12345-0@lo:400:kworker.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050008.205097:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789050008.205105:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704105984:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205134:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106368 00000100:00100000:0.0:1789050008.205136:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704105728:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205139:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106368 00000100:00100000:0.0:1789050008.205152:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704106240:0@lo:400:kworker.0 00000100:00100000:0.0:1789050008.205166:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704105856:0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205178:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106112 00000100:00100000:3.0:1789050008.205182:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106112 00000100:00100000:3.0:1789050008.205313:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789050008.205324:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704106368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205373:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704106368:12345-0@lo:400:kworker.0 Request processed in 53us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.205378:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789050008.205390:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789050008.205395:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704106112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050008.205424:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704106112:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050008.205430:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789050008.205608:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17c380 x1875954704106368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050008.205632:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704106368:0@lo:400:kworker.0 00000100:00080000:1.0:1789050008.207637:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050008.207645:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789050008.207702:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17d500 x1875954704106112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050008.207729:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704106112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050008.715680:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050008.715710:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704106496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050008.715799:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050008.715929:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106496 00000100:00100000:1.0:1789050008.715939:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106496 00000100:00100000:1.0:1789050008.715999:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789050008.716010:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704106496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050008.716054:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050008.716111:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704106496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050008.716118:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789050008.716176:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f7100 x1875954704106496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050008.716244:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704106496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050008.716592:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050009.290314:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050009.290346:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050009.290372:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050009.290402:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050009.290433:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493504 00000100:00100000:2.0:1789050009.290441:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493504 00000100:00100000:1.0:1789050009.290483:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493632 00000100:00100000:1.0:1789050009.290488:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493632 00000100:00100000:2.0:1789050009.290492:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493760 00000100:00100000:2.0:1789050009.290494:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493760 00000100:00100000:1.0:1789050009.290518:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:2.0:1789050009.290528:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:1.0:1789050009.290528:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691493632:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050009.290533:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:2349:x1875954691493504:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050009.290605:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493376 00000100:00100000:3.0:1789050009.290609:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493376 00000100:00100000:3.0:1789050009.290648:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 240 00000100:00100000:3.0:1789050009.290655:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691493376:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050009.290770:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:0.0:1789050009.290791:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691493760:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050009.290840:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:2349:x1875954691493504:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 306us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050009.290847:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00080000:2.0:1789050009.290876:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050009.290880:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050009.294798:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691493632:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 4260us (4440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050009.294813:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:3.0:1789050009.294883:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691493376:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 4215us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050009.294893:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 240 00000100:00100000:0.0:1789050009.294991:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691493760:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 4211us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050009.295001:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 85 00010000:00010000:1.0:1789050009.739755:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050010.402970:0:11603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789050010.763947:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789050011.275434:0:7074:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247263230666ns, next at 248263227576ns, rc = 0 00000100:00100000:2.0:1789050011.275651:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704106624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050011.275752:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050011.275947:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106624 00000100:00100000:3.0:1789050011.275957:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106624 00000100:00100000:3.0:1789050011.276039:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050011.276050:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704106624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050011.276092:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050011.276146:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704106624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050011.276154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789050011.276751:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789050011.276795:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17ed80 x1875954704106624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050011.276819:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704106624:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789050011.339786:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1789050011.339819:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1789050011.339851:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1789050011.340021:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050011.340045:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704106752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789050011.340114:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050011.345363:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106752 00000100:00100000:2.0:1789050011.345377:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106752 00000100:00100000:2.0:1789050011.345459:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050011.345472:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704106752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789050011.345500:0:6670:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789050011.345531:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x18d3fb809ea1ac00, atime: 0x18d3fb809ea1ac00, ctime: 0x18d3fb809ea1ac00, blocks: 0x1 00010000:00010000:2.0:1789050011.345539:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.345552:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=247s v=(0 0) 00010000:00010000:2.0:1789050011.345568:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050011.345573:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.345590:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.345599:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.345606:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.345628:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050011.345646:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050011.345661:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.345676:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050011.345681:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.345694:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.345722:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.345742:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b78c81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.345771:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050011.345773:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050011.345779:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050011.349481:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704106752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4005us (9358us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789050011.349494:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789050011.349725:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c7f7100/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789050011.349739:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704106752:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1789050011.455073:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc93a29440 20000000:00000080:2.0:1789050011.455088:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950605753000 uarg=0000000000000000 20000000:01000000:2.0:1789050011.455122:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789050011.455128:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789050011.455133:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789050011.455961:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789050011.456090:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789050011.461306:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789050011.461515:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789050011.461660:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789050011.461711:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789050011.461739:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461774:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461786:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461797:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b31 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461807:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461816:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78b4d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461826:0:11652:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461889:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.461915:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 18 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050011.461934:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704106880:0@lo:104: 00000100:00100000:2.0:1789050011.462093:0:11652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050011.462306:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.462318:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050011.462339:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107008:0@lo:104: 00000100:00100000:2.0:1789050011.462373:0:11652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050011.462548:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050011.462559:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 18 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050011.462570:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107136:0@lo:104: 00000100:00100000:2.0:1789050011.462607:0:11652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050011.462683:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704106880 00000100:00100000:1.0:1789050011.462693:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704106880 00000100:00100000:1.0:1789050011.462757:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107008 00000100:00100000:1.0:1789050011.462760:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107008 00000100:00100000:1.0:1789050011.462776:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050011.462787:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:11652:x1875954704106880:12345-0@lo:104: 00010000:00010000:1.0:1789050011.462802:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050011.462813:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789050011.462834:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:11652:x1875954704107008:12345-0@lo:104: 00010000:00010000:3.0:1789050011.462865:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.462879:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050011.462887:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+4:11652:x1875954704106880:12345-0@lo:104: Request processed in 102us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.462894:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789050011.462929:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050011.462937:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.462945:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488600 already unused, calling callback (ffffffffc1e0fc20) 00010000:00010000:3.0:1789050011.462961:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789050011.462969:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050011.462972:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11652:x1875954704107008:12345-0@lo:104: Request processed in 145us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050011.462996:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789050011.462996:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050011.463011:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050011.463018:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050011.463058:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.463065:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050011.463100:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050011.463101:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.463109:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.463111:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701488600/0x9df728c939b78b4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.463138:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950700030600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050011.463145:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.463152:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050011.463155:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.463157:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050011.463160:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789050011.463175:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050011.463181:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050011.463250:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.463256:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050011.463278:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.463304:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950700030600/0x9df728c939b78b3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b46 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.463319:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050011.463321:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050011.463322:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050011.463366:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704107264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050011.463407:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050011.463656:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107264 00000100:00100000:3.0:1789050011.463664:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107264 00010000:00010000:3.0:1789050011.463690:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050011.463726:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050011.463734:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704107264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050011.463744:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050011.463758:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050011.463768:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050011.463783:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050011.463816:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704107264:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050011.463823:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789050011.463871:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704107264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050011.463913:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704107392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050011.463933:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050011.463941:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789050011.463947:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 12 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050011.463957:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107520:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050011.463975:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107392 00000100:00100000:0.0:1789050011.463979:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107392 00010000:00010000:0.0:1789050011.463997:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 19 pid: 5812 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050011.464008:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050011.464015:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1789050011.464017:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050011.464024:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3282:x1875954704107392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050011.464025:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107648:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050011.464050:0:11652:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939480 going to sleep for 11 seconds 00010000:00010000:3.0:1789050011.464069:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331200/0x9df728c939b78b54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78b4d expref: 19 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050011.464091:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704106880:0@lo:104: 00000100:00100000:3.0:1789050011.464106:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107008:0@lo:104: 00010000:00010000:0.0:1789050011.464141:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050011.464149:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.464160:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.464169:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f800/0x9df728c939b78b46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78b3f expref: 18 pid: 5812 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050011.464183:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050011.464637:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3282:x1875954704107392:12345-0@lo:103:ldlm_bl.0 Request processed in 615us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050011.464655:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050011.464696:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789050011.464717:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107136 00000100:00100000:1.0:1789050011.464726:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107136 00000100:00100000:1.0:1789050011.464770:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789050011.464780:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c664450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11652:x1875954704107136:12345-0@lo:104: 00010000:00010000:1.0:1789050011.464797:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050011.464816:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704107392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050011.464908:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050011.464917:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c664450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+3:11652:x1875954704107136:12345-0@lo:104: Request processed in 139us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.464925:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789050011.464969:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107136:0@lo:104: 00010000:00010000:1.0:1789050011.465033:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050011.465040:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465048:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050011.465052:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465062:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050011.465069:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050011.465075:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789050011.465124:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465130:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050011.465160:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465168:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703331600/0x9df728c939b78b31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b78b38 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465197:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050011.465218:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050011.465219:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050011.465227:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050011.465240:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704107776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050011.465281:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050011.465466:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107776 00000100:00100000:1.0:1789050011.465512:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107776 00010000:00010000:1.0:1789050011.465533:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050011.465562:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050011.465569:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3282:x1875954704107776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050011.465580:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050011.465584:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465595:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465629:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ee00/0x9df728c939b78b38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b78b31 expref: 17 pid: 5810 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.465674:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050011.465743:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704107776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050011.465777:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704107776:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.465784:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789050011.472561:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107520:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050011.472669:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875954704107648:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050011.472720:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050011.478778:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050011.478875:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050011.479073:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691493888 00000100:00100000:1.0:1789050011.479110:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691493888 00010000:00010000:1.0:1789050011.479177:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 13 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050011.479257:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494016 00000100:00100000:1.0:1789050011.479261:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494016 00010000:00010000:1.0:1789050011.479278:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 14 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050011.479299:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:1.0:1789050011.479309:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+14:2348:x1875954691493888:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050011.479328:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050011.479335:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 14 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479349:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 14 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479371:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700030000/0x9df728c939b78b2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f799 expref: 14 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479391:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050011.479483:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691493888:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 174us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.479491:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:1.0:1789050011.479517:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:1.0:1789050011.479525:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:2348:x1875954691494016:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050011.479535:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050011.479541:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479561:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479573:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031800/0x9df728c939b78b23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f792 expref: 12 pid: 5811 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479586:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479596:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479615:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479624:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479633:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479641:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479648:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050011.479653:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479663:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479697:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.479711:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050011.479998:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:2348:x1875954691494016:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 417us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050011.480008:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00010000:00010000:3.0:1789050011.483337:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050011.483355:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050011.483362:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c50400/0x9df728c939b78c88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050011.788915:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789050012.812662:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789050012.812672:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95073d0e4000 from 7 10000000:01000000:3.0:1789050012.812678:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050012.812753:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050012.812767:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050012.812780:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050012.812822:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704107904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050012.812916:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050012.812991:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.813269:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704107904 00000100:00100000:2.0:1789050012.813279:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704107904 00000100:00100000:2.0:1789050012.813344:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789050012.813355:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:5815:x1875954704107904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050012.813383:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050012.813400:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51a00/0x9df728c939b78c96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78c8f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.813437:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51a00/0x9df728c939b78c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78c8f expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.813449:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51a00/0x9df728c939b78c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78c8f expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.813481:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51a00, rc 0) 00000100:00100000:2.0:1789050012.813545:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704107904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.813553:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789050012.813654:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704107904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050012.813671:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050012.813681:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050012.813754:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.813783:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050012.813831:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d15600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050012.814181:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108032 00000100:00100000:3.0:1789050012.814187:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108032 00000100:00100000:3.0:1789050012.814278:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789050012.814294:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704108032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050012.814594:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704108032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050012.814601:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789050012.814813:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.814861:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.814909:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050012.814944:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d15600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.815627:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108160 00000100:00100000:2.0:1789050012.815636:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108160 00000100:00100000:2.0:1789050012.815697:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789050012.815708:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704108160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.815960:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704108160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.815968:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789050012.820247:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108160:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1789050012.820666:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050012.824581:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11666:1875954704108288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050012.824712:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050012.824777:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050012.826054:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108288 00000100:00100000:3.0:1789050012.826071:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108288 00000100:00100000:3.0:1789050012.826156:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789050012.826176:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:11666:x1875954704108288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050012.826538:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:11666:x1875954704108288:12345-0@lo:502:llog_process_th.0 Request processed in 363us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050012.826546:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789050012.826690:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11666:1875954704108288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050012.826733:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050012.826744:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050012.826747:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050012.826755:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95073d0e4000 00000020:00000080:0.0:1789050012.826759:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789050012.826882:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11666:1875954704108416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050012.826931:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.826974:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050012.827173:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108416 00000100:00100000:1.0:1789050012.827180:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108416 00000100:00100000:1.0:1789050012.827258:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789050012.827267:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:11666:x1875954704108416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050012.827459:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:11666:x1875954704108416:12345-0@lo:502:llog_process_th.0 Request processed in 193us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050012.827467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789050012.827761:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11666:1875954704108416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050012.827789:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050012.827797:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050012.827799:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050012.827803:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789050012.830270:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789050012.830317:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050012.830330:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050012.830347:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050012.830365:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050012.830368:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95071009a800 from 7 10000000:01000000:1.0:1789050012.830372:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050012.830417:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050012.830438:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050012.830449:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050012.830478:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.830557:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050012.830613:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d15900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.830745:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108544 00000100:00100000:2.0:1789050012.830754:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108544 00000100:00100000:2.0:1789050012.830809:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789050012.830820:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:5815:x1875954704108544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050012.830835:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050012.830859:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51800/0x9df728c939b78ca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78c9d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.830886:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51800/0x9df728c939b78ca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78c9d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.830898:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51800/0x9df728c939b78ca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78c9d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.830918:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51800, rc 0) 00000100:00100000:2.0:1789050012.830973:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704108544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.830980:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789050012.831075:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050012.831103:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050012.831114:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050012.831702:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.831742:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050012.833235:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d15900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.838762:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108672 00000100:00100000:2.0:1789050012.838783:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108672 00000100:00100000:2.0:1789050012.838868:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789050012.838886:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704108672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.839764:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704108672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 881us (8016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.839774:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789050012.840634:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.841070:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050012.841148:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050012.841748:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d15900 going to sleep for 11 seconds 00000100:00100000:3.0:1789050012.843573:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108800 00000100:00100000:3.0:1789050012.843591:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108800 00000100:00100000:3.0:1789050012.843679:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789050012.843691:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704108800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050012.844376:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070a072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704108800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 683us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050012.844385:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789050012.845484:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704108800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050012.846774:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11669:1875954704108928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050012.846915:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.847019:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.847104:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704108928 00000100:00100000:2.0:1789050012.847113:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704108928 00000100:00100000:2.0:1789050012.847176:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789050012.847188:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:11669:x1875954704108928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050012.847979:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507013fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:11669:x1875954704108928:12345-0@lo:502:llog_process_th.0 Request processed in 790us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050012.848295:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11669:1875954704108928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050012.848334:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050012.848345:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050012.848348:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050012.848354:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95071009a800 00000020:00000080:0.0:1789050012.848357:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789050012.848509:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789050012.848894:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11669:1875954704109056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050012.848954:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.848998:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.850397:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109056 00000100:00100000:2.0:1789050012.850413:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109056 00000100:00100000:2.0:1789050012.850488:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789050012.850500:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:11669:x1875954704109056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050012.850806:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:11669:x1875954704109056:12345-0@lo:502:llog_process_th.0 Request processed in 308us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.850815:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789050012.850906:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11669:1875954704109056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789050012.850947:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050012.850957:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050012.850959:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789050012.850964:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789050012.851043:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789050012.851072:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050012.851084:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851098:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050012.851110:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050012.851113:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950707961800 from 7 10000000:01000000:2.0:1789050012.851116:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050012.851151:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851169:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851180:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050012.851229:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.851270:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050012.851303:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.851319:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109184 00000100:00100000:2.0:1789050012.851324:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109184 00000100:00100000:2.0:1789050012.851359:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789050012.851368:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:5815:x1875954704109184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050012.851379:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050012.851393:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51400/0x9df728c939b78cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b78cab expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851417:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51400/0x9df728c939b78cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b78cab expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851430:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51400/0x9df728c939b78cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b78cab expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851440:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51400, rc 0) 00000100:00100000:2.0:1789050012.851472:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704109184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.851478:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789050012.851512:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050012.851527:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.851537:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050012.851589:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.851614:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050012.851628:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.851639:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109312 00000100:00100000:2.0:1789050012.851642:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109312 00000100:00100000:2.0:1789050012.851669:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789050012.851675:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704109312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.851962:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704109312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.851969:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789050012.852001:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.852029:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.852067:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050012.852082:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050012.852093:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109440 00000100:00100000:2.0:1789050012.852097:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109440 00000100:00100000:2.0:1789050012.852118:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789050012.852125:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704109440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.852291:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:5815:x1875954704109440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050012.852298:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789050012.852335:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4c5df17a-77a5-4faa-ab5f-0191afbe3474:5815:1875954704109440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050012.854027:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11670:1875954704109568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050012.854556:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050012.854644:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050012.854758:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109568 00000100:00100000:3.0:1789050012.854769:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109568 00000100:00100000:3.0:1789050012.854822:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789050012.854833:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:11670:x1875954704109568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050012.855166:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:11670:x1875954704109568:12345-0@lo:502:llog_process_th.0 Request processed in 326us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050012.855175:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789050012.855482:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11670:1875954704109568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050012.855520:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050012.855531:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050012.855534:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050012.855541:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff950707961800 00000020:00000080:0.0:1789050012.855544:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789050012.855648:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11670:1875954704109696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050012.855691:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050012.855721:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109696 00000100:00100000:0.0:1789050012.855726:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109696 00000100:00100000:0.0:1789050012.855753:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789050012.855761:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:11670:x1875954704109696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050012.855927:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:11670:x1875954704109696:12345-0@lo:502:llog_process_th.0 Request processed in 167us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050012.855935:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789050012.855983:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050012.855996:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4c5df17a-77a5-4faa-ab5f-0191afbe3474:11670:1875954704109696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050012.856016:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050012.856020:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050012.856022:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050012.856026:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789050012.856804:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789050012.856830:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050012.856843:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050012.856880:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050012.873743:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050013.324327:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704110080:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.324553:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050013.324657:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050013.324665:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704110208:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.324697:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050013.324823:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110080 00000100:00100000:1.0:1789050013.324836:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110080 00000100:00100000:0.0:1789050013.324853:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704109824:0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.324898:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050013.324938:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704110336:0@lo:400:kworker.0 00000100:00100000:3.0:1789050013.324948:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704109952:0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.324971:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050013.325008:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050013.325032:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704110464:0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.325048:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110208 00000100:00100000:0.0:1789050013.325055:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110208 00000100:00100000:3.0:1789050013.325058:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789050013.325102:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050013.325125:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110464 00000100:00100000:0.0:1789050013.325130:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110464 00000100:00100000:3.0:1789050013.325133:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050013.325146:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704110208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.325165:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789050013.325177:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704110464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050013.325239:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704110208:12345-0@lo:400:kworker.0 Request processed in 95us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.325249:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050013.325257:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704110464:12345-0@lo:400:kworker.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050013.325265:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789050013.325299:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789050013.325313:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f7800 x1875954704110464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050013.325330:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704110464:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.325438:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109824 00000100:00100000:2.0:1789050013.325442:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109824 00000100:00100000:2.0:1789050013.325472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789050013.325479:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704109824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.325518:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704109824:12345-0@lo:400:kworker.0 Request processed in 40us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.325522:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110336 00000100:00100000:2.0:1789050013.325527:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789050013.325528:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110336 00000100:00100000:1.0:1789050013.325553:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704109952 00000100:00100000:1.0:1789050013.325556:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704109952 00000100:00100000:2.0:1789050013.325567:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789050013.325758:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704110080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.325795:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704110080:12345-0@lo:400:kworker.0 Request processed in 41us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.325961:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789050013.325970:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704110336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.326006:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704110336:12345-0@lo:400:kworker.0 Request processed in 39us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.326013:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789050013.326027:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050013.326034:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704109952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.326070:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704109952:12345-0@lo:400:kworker.0 Request processed in 36us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.326086:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789050013.326118:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050013.326141:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704109824:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.326153:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704110336:0@lo:400:kworker.0 00000100:00100000:1.0:1789050013.326193:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704109952:0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.329650:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704110208:0@lo:400:kworker.0 00000100:00100000:0.0:1789050013.329674:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704110080:0@lo:400:kworker.0 00000100:00100000:2.0:1789050013.335789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789050013.387961:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050013.388196:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494144 00000100:00100000:3.0:1789050013.388228:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494144 00000100:00100000:3.0:1789050013.388474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 257 00000100:00100000:3.0:1789050013.388486:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:5591:x1875954691494144:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050013.388505:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050013.388526:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489000/0x9df728c939b78cb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7e6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050013.388560:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489000/0x9df728c939b78cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7e6 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050013.388582:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489000/0x9df728c939b78cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7e6 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050013.388597:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489000, rc 0) 00000100:00100000:3.0:1789050013.388678:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494144:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 194us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.388708:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 257 00000100:00100000:2.0:1789050013.390887:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050013.390990:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494272 00000100:00100000:0.0:1789050013.391425:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494272 00000100:00100000:0.0:1789050013.391546:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 258 00000100:00100000:0.0:1789050013.391559:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494272:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050013.391948:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494272:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 391us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050013.391957:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 258 00000100:00100000:1.0:1789050013.394758:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050013.394870:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494400 00000100:00100000:2.0:1789050013.394882:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494400 00000100:00100000:2.0:1789050013.394946:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 259 00000100:00100000:2.0:1789050013.394958:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494400:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050013.395534:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507207d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494400:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 576us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050013.395545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 259 00000100:00100000:2.0:1789050013.400004:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050013.400465:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494528 00000100:00100000:1.0:1789050013.400480:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494528 00000100:00100000:1.0:1789050013.400591:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 260 00000100:00100000:1.0:1789050013.400604:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:9942:x1875954691494528:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050013.400932:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:9942:x1875954691494528:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 330us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.400941:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 260 00000100:00100000:1.0:1789050013.409657:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050013.409739:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494656 00000100:00100000:3.0:1789050013.409753:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494656 00000100:00100000:3.0:1789050013.409826:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 261 00000100:00100000:3.0:1789050013.409839:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:9942:x1875954691494656:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050013.410189:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:9942:x1875954691494656:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 351us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.410237:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 261 00000100:00100000:3.0:1789050013.416615:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050013.416764:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494784 00000100:00100000:1.0:1789050013.416778:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494784 00000100:00100000:1.0:1789050013.417017:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 262 00000100:00100000:1.0:1789050013.417030:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:5591:x1875954691494784:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050013.417054:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050013.417077:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05fa00/0x9df728c939b78cc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050013.417113:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05fa00/0x9df728c939b78cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ed expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050013.417146:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05fa00/0x9df728c939b78cc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ed expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050013.417157:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05fa00, rc 0) 00000100:00100000:1.0:1789050013.417282:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691494784:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 254us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.417290:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 262 00000100:00100000:2.0:1789050013.423827:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050013.423973:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691494912 00000100:00100000:3.0:1789050013.423986:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691494912 00000100:00100000:3.0:1789050013.424053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 263 00000100:00100000:3.0:1789050013.424065:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691494912:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050013.425549:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691494912:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 1475us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.425566:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 263 00000100:00100000:3.0:1789050013.433809:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050013.435998:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495040 00000100:00100000:1.0:1789050013.436020:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495040 00000100:00100000:1.0:1789050013.436115:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 264 00000100:00100000:1.0:1789050013.436127:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691495040:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050013.436933:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:5591:x1875954691495040:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 801us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.436945:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 264 00000100:00100000:1.0:1789050013.445033:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050013.445280:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495168 00000100:00100000:3.0:1789050013.445294:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495168 00000100:00100000:3.0:1789050013.445417:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 265 00000100:00100000:3.0:1789050013.445440:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:9945:x1875954691495168:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050013.445792:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:9945:x1875954691495168:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 354us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.445801:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 265 00000100:00100000:2.0:1789050013.451551:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050013.451657:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495296 00000100:00100000:1.0:1789050013.451670:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495296 00000100:00100000:1.0:1789050013.451746:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 266 00000100:00100000:1.0:1789050013.451757:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:9945:x1875954691495296:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050013.452084:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:9945:x1875954691495296:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 327us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050013.452094:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 266 00000100:00100000:2.0:1789050013.835418:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050013.835449:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704110592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050013.835606:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050013.836040:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050013.837340:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110592 00000100:00100000:3.0:1789050013.837357:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110592 00000100:00100000:3.0:1789050013.837447:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050013.837461:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704110592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050013.837513:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050013.837615:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704110592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050013.837622:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789050013.837775:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f5c00 x1875954704110592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050013.837799:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704110592:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789050013.899891:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789050014.414141:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050014.414186:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050014.414264:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050014.414318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050014.414446:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495680 00000100:00100000:3.0:1789050014.414459:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495680 00000100:00100000:3.0:1789050014.414548:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789050014.414561:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691495680:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050014.414651:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691495680:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050014.414660:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789050014.414769:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495424 00000100:00100000:3.0:1789050014.414774:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495424 00000100:00100000:3.0:1789050014.414806:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 267 00000100:00100000:3.0:1789050014.414814:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691495424:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050014.414859:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691495424:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 46us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050014.414866:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 267 00000100:00080000:1.0:1789050014.414973:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050014.415159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495552 00000100:00100000:2.0:1789050014.415165:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495552 00000100:00100000:2.0:1789050014.415253:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495808 00000100:00100000:2.0:1789050014.415257:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495808 00000100:00100000:2.0:1789050014.415284:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:2.0:1789050014.415291:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691495552:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050014.415331:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691495552:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 41us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050014.415338:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:2.0:1789050014.415354:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:2.0:1789050014.415361:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691495808:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050014.415387:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691495808:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 27us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050014.415408:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00080000:1.0:1789050014.415477:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789050014.860088:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050015.883536:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050016.395470:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050016.395501:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704110720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050016.395597:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050016.395750:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110720 00000100:00100000:2.0:1789050016.395761:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110720 00000100:00100000:2.0:1789050016.395863:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789050016.395877:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704110720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050016.395924:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050016.395990:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704110720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050016.396000:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789050016.396090:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050016.396163:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704110720:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789050016.456761:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789050016.907600:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050017.933032:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050018.451826:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704110848:0@lo:400:kworker.0 00000100:00100000:1.0:1789050018.451934:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050018.452153:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110848 00000100:00100000:3.0:1789050018.452164:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110848 00000100:00100000:0.0:1789050018.452226:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704110976:0@lo:400:kworker.0 00000100:00100000:3.0:1789050018.452255:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789050018.452268:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704110848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.452271:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.452336:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704110976 00000100:00100000:0.0:1789050018.452340:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704110976 00000100:00100000:0.0:1789050018.452374:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789050018.452381:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704110976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.452429:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704110976:12345-0@lo:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.452436:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789050018.452476:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704110976:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.456646:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704111232:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.456646:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704111104:0@lo:400:kworker.0 00000100:00100000:1.0:1789050018.457014:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704110848:0@lo:400:kworker.0 00000100:00100000:1.0:1789050018.457049:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704111360:0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.461958:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.462059:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111104 00000100:00100000:0.0:1789050018.462070:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111104 00000100:00100000:0.0:1789050018.462142:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789050018.462158:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704111104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.462273:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704111104:12345-0@lo:400:kworker.0 Request processed in 121us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.462281:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789050018.462305:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050018.462349:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704111104:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.462702:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.462754:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111232 00000100:00100000:2.0:1789050018.462760:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111232 00000100:00100000:2.0:1789050018.462798:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789050018.462806:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.462865:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704111232:12345-0@lo:400:kworker.0 Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.462872:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789050018.462893:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050018.462909:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704111488:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.462949:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050018.462983:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111488 00000100:00100000:2.0:1789050018.462987:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111488 00000100:00100000:2.0:1789050018.463017:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050018.463023:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.463074:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704111488:12345-0@lo:400:kworker.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050018.463080:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789050018.463097:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050018.463119:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073f42f480 x1875954704111488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050018.463196:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704111488:0@lo:400:kworker.0 00000100:00100000:2.0:1789050018.463341:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789050018.463347:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c7f7100, transno 4294967300 00000100:00100000:2.0:1789050018.463364:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704111232:0@lo:400:kworker.0 00000100:00100000:3.0:1789050018.464115:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704110848:12345-0@lo:400:kworker.0 Request processed in 11845us (12175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050018.464138:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789050018.467388:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050018.467695:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111360 00000100:00100000:0.0:1789050018.467710:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111360 00000100:00100000:0.0:1789050018.467813:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789050018.467836:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704111360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050018.467927:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704111360:12345-0@lo:400:kworker.0 Request processed in 95us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050018.467935:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1789050018.468221:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050018.468345:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704111360:0@lo:400:kworker.0 00000100:00100000:3.0:1789050018.955671:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050018.955700:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704111616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050018.955807:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050018.956481:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050018.958149:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111616 00000100:00100000:1.0:1789050018.958165:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111616 00000100:00100000:1.0:1789050018.958270:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050018.958297:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704111616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050018.958348:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050018.958475:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704111616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050018.958483:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789050018.958611:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f6300 x1875954704111616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050018.958635:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704111616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050019.534050:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050019.534103:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050019.534261:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496064 00000100:00100000:0.0:1789050019.534273:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496064 00000100:00100000:0.0:1789050019.534357:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496320 00000100:00100000:0.0:1789050019.534361:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496320 00000100:00100000:0.0:1789050019.534410:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:0.0:1789050019.534422:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496064:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050019.534804:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:3.0:1789050019.534824:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691496320:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050019.534900:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496064:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 479us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050019.534908:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00080000:2.0:1789050019.535000:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050019.542565:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691496320:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 6276us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050019.542597:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:0.0:1789050019.542852:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050019.542913:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050019.543015:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691495936 00000100:00100000:3.0:1789050019.543026:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691495936 00000100:00100000:3.0:1789050019.543083:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 269 00000100:00100000:3.0:1789050019.543093:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2347:x1875954691495936:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050019.543181:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2347:x1875954691495936:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050019.543226:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 269 00000100:00100000:1.0:1789050019.550096:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496192 00000100:00100000:1.0:1789050019.550118:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496192 00000100:00100000:1.0:1789050019.550261:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050019.550274:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496192:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050019.550652:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496192:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 378us (7736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050019.550662:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00080000:2.0:1789050019.552697:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789050019.979481:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050021.007294:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050021.516865:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050021.516887:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704111744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050021.516964:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050021.517031:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111744 00000100:00100000:0.0:1789050021.517038:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111744 00000100:00100000:0.0:1789050021.517091:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789050021.517102:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704111744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050021.517132:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050021.517172:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704111744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050021.517179:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789050021.517197:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050021.517243:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704111744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789050022.031654:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050023.056683:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050023.115842:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050023.564240:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704112256:0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.564305:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050023.564369:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050023.564376:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704112128:0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.564401:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050023.564429:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112256 00000100:00100000:3.0:1789050023.564436:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112256 00000100:00100000:3.0:1789050023.564489:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050023.564498:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704112256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050023.564840:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112128 00000100:00100000:0.0:1789050023.564845:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112128 00000100:00100000:0.0:1789050023.564894:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789050023.564903:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704112128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050023.564970:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704111872:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.565764:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704112000:0@lo:400:kworker.0 00000100:00100000:0.0:1789050023.570136:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704112128:12345-0@lo:400:kworker.0 Request processed in 5227us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050023.570151:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789050023.570196:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050023.570217:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050023.570289:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704112128:0@lo:400:kworker.0 00000100:00100000:1.0:1789050023.570512:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050023.570567:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704112384:0@lo:400:kworker.0 00000100:00100000:1.0:1789050023.570606:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050023.570641:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112384 00000100:00100000:1.0:1789050023.570648:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112384 00000100:00100000:1.0:1789050023.570696:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789050023.570703:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704112384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050023.570752:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704112384:12345-0@lo:400:kworker.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050023.570758:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789050023.570775:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050023.570806:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704112384:0@lo:400:kworker.0 00000100:00100000:0.0:1789050023.570984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704111872 00000100:00100000:0.0:1789050023.570989:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704111872 00000100:00100000:0.0:1789050023.571022:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789050023.571029:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704111872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050023.571080:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704111872:12345-0@lo:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050023.571087:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789050023.571217:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704111872:0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.576255:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704112256:12345-0@lo:400:kworker.0 Request processed in 11749us (11940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050023.576269:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789050023.577241:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050023.577292:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704112512:0@lo:400:kworker.0 00000100:00100000:2.0:1789050023.577331:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050023.577587:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112512 00000100:00100000:1.0:1789050023.577595:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112512 00000100:00100000:1.0:1789050023.577657:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789050023.577668:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704112512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050023.577719:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704112512:12345-0@lo:400:kworker.0 Request processed in 54us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050023.577725:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789050023.577998:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789050023.578253:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950707e6ea00 x1875954704112512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050023.578268:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704112512:0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.578423:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112000 00000100:00100000:3.0:1789050023.578429:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112000 00000100:00100000:3.0:1789050023.578474:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789050023.578483:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704112000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050023.578558:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704112000:12345-0@lo:400:kworker.0 Request processed in 76us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050023.578564:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789050023.578720:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704112000:0@lo:400:kworker.0 00000100:00100000:0.0:1789050023.579907:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704112256:0@lo:400:kworker.0 00010000:00010000:3.0:1789050024.075513:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050024.075671:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050024.075700:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704112640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050024.075762:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050024.075980:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112640 00000100:00100000:2.0:1789050024.075989:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112640 00000100:00100000:2.0:1789050024.076039:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050024.076049:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704112640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050024.076079:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050024.076132:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704112640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050024.076139:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789050024.076293:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c7f6300 x1875954704112640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050024.076325:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704112640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050024.654898:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050024.654935:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050024.654972:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050024.655009:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050024.655033:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496448 00000100:00100000:0.0:1789050024.655043:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496448 00000100:00100000:1.0:1789050024.655102:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496832 00000100:00100000:0.0:1789050024.655104:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 271 00000100:00100000:1.0:1789050024.655109:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496832 00000100:00100000:0.0:1789050024.655119:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691496448:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050024.655153:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:3.0:1789050024.655162:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496576 00000100:00100000:1.0:1789050024.655164:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691496832:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050024.655168:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496576 00000100:00100000:0.0:1789050024.655194:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691496448:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050024.655226:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 271 00000100:00100000:1.0:1789050024.655237:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691496832:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050024.655240:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:3.0:1789050024.655248:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496576:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050024.655264:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:3.0:1789050024.655283:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2347:x1875954691496576:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050024.655290:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:1.0:1789050024.655305:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496704 00000100:00100000:1.0:1789050024.655312:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496704 00000100:00100000:1.0:1789050024.655351:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:1.0:1789050024.655359:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691496704:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050024.655403:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691496704:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050024.655409:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00080000:2.0:1789050024.655581:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050024.655587:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050025.103530:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050026.125631:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050026.637171:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050026.637236:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704112768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050026.637395:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050026.638009:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112768 00000100:00100000:2.0:1789050026.638021:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112768 00000100:00080000:3.0:1789050026.638143:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050026.638178:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789050026.638193:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704112768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050026.638295:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050026.638654:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704112768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 464us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050026.638663:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789050026.639063:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704112768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789050027.147495:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050028.171426:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050028.684775:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704113280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.684810:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704113024:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.684864:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050028.684864:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050028.684927:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704112896:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.685008:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704113152:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.691979:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704113536:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.692065:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050028.692150:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113280 00000100:00100000:2.0:1789050028.692160:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113280 00000100:00100000:1.0:1789050028.692189:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050028.692230:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704113408:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.692232:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113536 00000100:00100000:2.0:1789050028.692235:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113536 00000100:00100000:2.0:1789050028.692259:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050028.692260:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050028.692269:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704113280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.692292:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050028.692299:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704113536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.692327:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704113280:12345-0@lo:400:kworker.0 Request processed in 59us (7463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050028.692330:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704113536:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050028.692334:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050028.692337:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050028.692370:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113024 00000100:00100000:1.0:1789050028.692373:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113024 00010000:00080000:2.0:1789050028.692377:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c66f800 x1875954704113536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050028.692393:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704113536:0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.692398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113408 00000100:00100000:1.0:1789050028.692400:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113408 00000100:00100000:1.0:1789050028.692420:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789050028.692440:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789050028.692442:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704113024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.692446:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.692498:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704113024:12345-0@lo:400:kworker.0 Request processed in 56us (7635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050028.692505:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789050028.692526:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704112896 00000100:00100000:1.0:1789050028.692530:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704112896 00000100:00100000:1.0:1789050028.692556:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789050028.692563:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704112896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.692597:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704112896:12345-0@lo:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050028.692603:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789050028.692640:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704112896:0@lo:400:kworker.0 00000100:00080000:1.0:1789050028.692668:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050028.692674:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050028.692676:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050028.695877:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704113280:0@lo:400:kworker.0 00000100:00100000:2.0:1789050028.695979:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704113408:12345-0@lo:400:kworker.0 Request processed in 3529us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050028.695995:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789050028.696061:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704113024:0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.696846:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704113408:0@lo:400:kworker.0 00000100:00100000:3.0:1789050028.696955:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050028.697057:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113152 00000100:00100000:1.0:1789050028.697066:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113152 00000100:00100000:1.0:1789050028.697155:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789050028.697165:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704113152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050028.697266:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704113152:12345-0@lo:400:kworker.0 Request processed in 102us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050028.697273:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789050028.697398:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704113152:0@lo:400:kworker.0 00000100:00080000:3.0:1789050028.697453:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050029.195623:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704113664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050029.195711:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050029.195954:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113664 00000100:00100000:3.0:1789050029.195965:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113664 00000100:00100000:3.0:1789050029.196030:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789050029.196041:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704113664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050029.196098:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050029.196168:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704113664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.196175:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789050029.196276:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c17ca80 x1875954704113664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050029.196298:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704113664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050029.197328:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050029.770073:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050029.770402:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691496960 00000100:00100000:0.0:1789050029.770416:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691496960 00000100:00100000:0.0:1789050029.770548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 273 00000100:00100000:0.0:1789050029.770562:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691496960:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050029.770661:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691496960:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 102us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050029.770685:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 273 00000100:00100000:3.0:1789050029.771493:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050029.771532:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497088 00000100:00100000:3.0:1789050029.771539:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497088 00000100:00100000:3.0:1789050029.771599:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 104 00000100:00100000:3.0:1789050029.771608:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691497088:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050029.771658:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691497088:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.771665:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 104 00000100:00080000:3.0:1789050029.771684:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050029.780576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050029.780631:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050029.780776:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497216 00000100:00100000:3.0:1789050029.780789:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497216 00000100:00100000:3.0:1789050029.781075:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050029.781088:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2346:x1875954691497216:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:3.0:1789050029.781126:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78bfc 00000100:00080000:3.0:1789050029.781136:0:6670:0:(import.c:65:import_set_state_nolock()) ffff95073c5d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050029.781184:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1789050029.781361:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050029.781431:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497344 00000100:00100000:1.0:1789050029.781438:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497344 00000100:00100000:1.0:1789050029.781487:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 105 00000100:00100000:1.0:1789050029.781495:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691497344:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050029.781580:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691497344:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 85us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050029.781588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 105 00000100:00080000:2.0:1789050029.782074:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050029.782097:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050029.782736:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+2:2346:x1875954691497216:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 1646us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050029.782746:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00010000:00010000:2.0:1789050030.219496:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050031.243796:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050031.767690:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704113792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050031.768399:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050031.769980:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113792 00000100:00100000:3.0:1789050031.769998:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113792 00000100:00080000:2.0:1789050031.770072:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050031.770238:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789050031.770255:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704113792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050031.770300:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050031.771063:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704113792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 811us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050031.771084:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789050031.771242:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704113792:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789050031.820529:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:3.0:1789050031.820540:0:6698:0:(genops.c:885:class_export_put()) final put ffff95073c5d1800/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:0.0:1789050031.820654:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c5d1800/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-OST0000 00000020:00000080:0.0:1789050031.820732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073c5d3800 for lustre-OST0000 00010000:00010000:0.0:1789050032.268960:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050033.291298:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050033.356698:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789050033.804222:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704114176:0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.804484:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050033.804565:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050033.804572:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704114304:0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.804602:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050033.804647:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114304 00000100:00100000:0.0:1789050033.804656:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114304 00000100:00100000:0.0:1789050033.804720:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789050033.804745:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704114304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.804815:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704114304:12345-0@lo:400:kworker.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050033.804823:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789050033.804847:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050033.805011:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114176 00000100:00100000:1.0:1789050033.805016:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114176 00000100:00100000:1.0:1789050033.805056:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789050033.805064:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.805101:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704114176:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.805106:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1789050033.805138:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050033.805169:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704114304:0@lo:400:kworker.0 00000100:00100000:0.0:1789050033.805185:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704114176:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805288:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704114048:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805336:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050033.805375:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704114560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805396:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050033.805430:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789050033.805436:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704113920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805464:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050033.805490:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704114432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805510:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050033.805541:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704113920 00000100:00100000:3.0:1789050033.805545:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704113920 00000100:00100000:3.0:1789050033.805575:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050033.805582:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704113920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805617:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704113920:12345-0@lo:400:kworker.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050033.805624:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789050033.805650:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114048 00000100:00100000:3.0:1789050033.805654:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114048 00000100:00100000:3.0:1789050033.805676:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114432 00000100:00100000:3.0:1789050033.805679:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114432 00000100:00100000:3.0:1789050033.805704:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050033.805710:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704114048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805756:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704114048:12345-0@lo:400:kworker.0 Request processed in 46us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050033.805781:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050033.805794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789050033.805800:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704114432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805831:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704114432:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050033.805837:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789050033.805857:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050033.805877:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704113920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805901:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704114432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050033.805910:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704114048:0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.806245:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114560 00000100:00100000:1.0:1789050033.806251:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114560 00000100:00100000:1.0:1789050033.806287:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789050033.806296:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704114560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050033.806338:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704114560:12345-0@lo:400:kworker.0 Request processed in 44us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050033.806344:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789050033.806462:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789050033.806487:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033db800 x1875954704114560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789050049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050033.806500:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704114560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050034.315554:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050034.315587:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050034.315662:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789050034.315925:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050034.316010:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114688 00000100:00100000:1.0:1789050034.316018:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114688 00000100:00100000:1.0:1789050034.316067:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789050034.316077:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704114688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050034.316139:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050034.316225:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704114688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050034.316234:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789050034.316387:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9507033db800 x1875954704114688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050034.316405:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704114688:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789050034.864756:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:20:34 (1789050034) 00000100:00100000:2.0:1789050034.889641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050034.889691:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050034.889740:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050034.889803:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497600 00000100:00100000:3.0:1789050034.889812:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497600 00000100:00100000:3.0:1789050034.889878:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497728 00000100:00100000:3.0:1789050034.889882:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497728 00000100:00100000:3.0:1789050034.889904:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 109 00000100:00100000:3.0:1789050034.889914:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691497600:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050034.889980:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691497600:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 67us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050034.889999:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 109 00000100:00100000:3.0:1789050034.890015:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:3.0:1789050034.890021:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691497728:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050034.890045:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691497728:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050034.890050:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:0.0:1789050034.891965:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497472 00000100:00100000:0.0:1789050034.891975:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497472 00000100:00100000:0.0:1789050034.892024:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 275 00000100:00100000:0.0:1789050034.892041:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691497472:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050034.892109:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691497472:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 70us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050034.892117:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 275 00000100:00080000:2.0:1789050034.893887:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789050035.339522:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050036.132546:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050036.132698:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497856 00000100:00100000:1.0:1789050036.132707:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497856 00000100:00100000:1.0:1789050036.132785:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:1.0:1789050036.132795:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:10214:x1875954691497856:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050036.132814:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050036.132842:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78cc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7f4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.132921:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.132935:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.132946:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050036.132981:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789050036.132985:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050036.133034:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.133058:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78cc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7f4 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.133093:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7f4 expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.133102:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4800) 00010000:00010000:1.0:1789050036.133105:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050036.133109:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e200, rc 0) 00000100:00100000:1.0:1789050036.133173:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:10214:x1875954691497856:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 379us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050036.133181:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00080000:2.0:1789050036.133607:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050036.141316:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050036.142278:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691497984 00000100:00100000:3.0:1789050036.142295:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691497984 00000100:00100000:3.0:1789050036.142371:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:3.0:1789050036.142382:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:10215:x1875954691497984:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050036.142406:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050036.142431:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78cd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f7fb expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142508:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142525:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142538:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142556:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142563:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.142591:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144307:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144333:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144345:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050036.144387:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050036.144391:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050036.144417:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144429:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144435:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144444:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144450:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050036.144455:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144464:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144491:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4800) 00010000:00010000:3.0:1789050036.144494:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050036.144501:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144508:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144525:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144532:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144538:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144544:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050036.144546:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144552:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144559:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9507114dc700) 00010000:00010000:3.0:1789050036.144562:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050036.144565:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144570:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78ce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144628:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78cd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7fb expref: 8 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144646:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7fb expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050036.144653:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507114dc400) 00010000:00010000:3.0:1789050036.144655:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050036.144657:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489c00, rc 0) 00000100:00100000:3.0:1789050036.144762:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:10215:x1875954691497984:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 2380us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050036.144772:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:0.0:1789050036.149284:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050036.149394:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691498240 00000100:00100000:3.0:1789050036.149406:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691498240 00000100:00100000:1.0:1789050036.149563:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:1.0:1789050036.149578:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:10215:x1875954691498240:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050036.149599:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050036.149619:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78cf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f802 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149698:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149711:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149733:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149788:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149825:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.149833:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150173:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b78d06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150183:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b78d06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150190:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b78d06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050036.150229:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789050036.150384:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150392:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150399:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150405:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050036.150410:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150417:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150440:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507114dc400) 00010000:00010000:1.0:1789050036.150443:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050036.150447:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150454:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b78cf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150467:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150473:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150479:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150484:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050036.150487:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150494:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150501:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff950732cb4300) 00010000:00010000:1.0:1789050036.150504:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050036.150507:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150513:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78cff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150952:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78cf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f802 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150968:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b78d06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f802 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050036.150975:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:1.0:1789050036.150977:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050036.150980:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f200, rc 0) 00000100:00100000:1.0:1789050036.151049:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:10215:x1875954691498240:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1474us (1853us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789050036.151057:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:2.0:1789050036.164642:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050036.164757:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691498368 00000100:00100000:0.0:1789050036.164767:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691498368 00000100:00100000:0.0:1789050036.164823:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:0.0:1789050036.164833:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:10215:x1875954691498368:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789050036.164944:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:10215:x1875954691498368:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050036.164951:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00010000:00010000:0.0:1789050036.368936:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050036.430174:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789050036.876476:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704114816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050036.876537:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050036.877146:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704114816 00000100:00100000:3.0:1789050036.877155:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704114816 00000100:00100000:3.0:1789050036.877237:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050036.877246:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704114816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050036.877275:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050036.878424:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704114816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1176us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050036.878433:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050036.878484:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704114816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050036.878767:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789050036.908783:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1789050037.389090:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050037.835395:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050037.835887:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691498496 00000100:00100000:1.0:1789050037.835897:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691498496 00000100:00100000:1.0:1789050037.835954:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:1.0:1789050037.835964:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:10257:x1875954691498496:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050037.835983:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050037.836054:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f809 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836117:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836130:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836141:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836167:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836174:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836181:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836401:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836409:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836416:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836422:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050037.836426:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836433:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836444:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4800) 00010000:00010000:1.0:1789050037.836447:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050037.836452:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836458:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836476:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836482:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836488:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836493:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050037.836496:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836502:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836511:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff950732cb4400) 00010000:00010000:1.0:1789050037.836513:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050037.836516:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836521:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78d22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836553:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78d14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f809 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836563:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4800) 00010000:00010000:1.0:1789050037.836566:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050037.836576:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f809 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050037.836587:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f000, rc 0) 00000100:00100000:1.0:1789050037.836648:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:10257:x1875954691498496:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 685us (1263us total) trans 0 rc 301/301 00000100:00100000:1.0:1789050037.836655:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:1.0:1789050037.844537:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050037.844658:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691498752 00000100:00100000:0.0:1789050037.844668:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691498752 00000100:00100000:0.0:1789050037.844739:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:0.0:1789050037.844749:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:10257:x1875954691498752:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:0.0:1789050037.844798:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050037.844823:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78cce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7f4 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.844841:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4800) 00010000:00010000:0.0:1789050037.844853:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050037.845060:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.845073:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.845084:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.845095:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.845103:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050037.845109:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050037.847374:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789050037.847390:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847400:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847407:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847412:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050037.847416:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847423:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847437:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52d00) 00010000:00010000:3.0:1789050037.847441:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050037.847445:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.847451:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78d29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050037.847467:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000840a1ea8 reply state 00000000a46d60dc transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050037.847476:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050037.848124:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:10257:x1875954691498752:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 3371us (3590us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789050037.848142:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00010000:00010000:3.0:1789050037.852779:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852795:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852803:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852809:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050037.852813:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852821:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852836:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff950714b52600) 00010000:00010000:3.0:1789050037.852839:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050037.852843:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.852848:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78d30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050037.942432:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050037.942625:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691498880 00000100:00100000:3.0:1789050037.942634:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691498880 00000100:00100000:3.0:1789050037.942697:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:3.0:1789050037.942707:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:10265:x1875954691498880:12345-192.168.206.1@tcp:101:lctl.0 00010000:00010000:3.0:1789050037.942739:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050037.942771:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78d37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f810 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.943125:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.943140:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.943151:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050037.943185:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050037.943188:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050037.943248:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.943272:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f810 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.945585:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f810 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050037.945600:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:3.0:1789050037.945602:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050037.945605:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488600, rc 0) 00000100:00100000:3.0:1789050037.945679:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:10265:x1875954691498880:12345-192.168.206.1@tcp:101:lctl.0 Request processed in 2972us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050037.945687:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:2.0:1789050038.024440:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.024480:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499008 00000100:00100000:2.0:1789050038.024489:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499008 00000100:00100000:2.0:1789050038.024562:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789050038.024572:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+9:10271:x1875954691499008:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050038.024590:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050038.024607:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78d45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f817 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024667:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024681:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024721:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024737:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024744:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024750:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789050038.024860:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050038.024915:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.024992:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025000:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050038.025025:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789050038.025029:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050038.025074:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025085:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025092:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025109:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025115:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050038.025118:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025125:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025136:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:2.0:1789050038.025139:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050038.025142:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025148:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78d4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025158:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025163:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025544:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025550:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050038.025553:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025570:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025580:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95072c9b1300) 00010000:00010000:2.0:1789050038.025582:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050038.025586:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025592:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78d53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025624:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78d45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f817 expref: 11 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025637:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f817 expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.025643:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050038.025645:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050038.025647:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51000, rc 0) 00000100:00100000:2.0:1789050038.025707:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+10:10271:x1875954691499008:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1136us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050038.025722:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:1.0:1789050038.029425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.030461:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499264 00000100:00100000:3.0:1789050038.030485:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499264 00000100:00100000:3.0:1789050038.030543:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:3.0:1789050038.030553:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+10:10271:x1875954691499264:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050038.030571:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050038.030591:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78d61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f81e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.030730:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.030745:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.030756:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.030813:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.031064:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.031074:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050038.032124:0:5818:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789050038.032399:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032412:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032434:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032543:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032551:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032557:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032562:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050038.032566:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032572:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032583:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050038.032586:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050038.032591:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032597:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489600/0x9df728c939b78d68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050038.032674:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000318214a3 reply state 000000005e8dd717 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.032682:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789050038.032803:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b78d61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032820:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.032827:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:3.0:1789050038.032830:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050038.032832:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25e00, rc 0) 00000100:00100000:3.0:1789050038.034384:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+13:10271:x1875954691499264:12345-192.168.206.1@tcp:101:bash.0 Request processed in 3825us (5100us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789050038.034395:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00010000:00010000:2.0:1789050038.038273:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038298:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038324:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038330:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050038.038334:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038342:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038358:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9507114dc300) 00010000:00010000:2.0:1789050038.038362:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050038.038367:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.038373:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488c00/0x9df728c939b78d6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.047611:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.047943:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499392 00000100:00100000:2.0:1789050038.047952:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499392 00000100:00100000:2.0:1789050038.047999:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789050038.048007:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875954691499392:12345-192.168.206.1@tcp:8:bash.0 00010000:00080000:2.0:1789050038.048037:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1789050038.048079:0:6671:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78d84 00002000:00100000:2.0:1789050038.048091:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2c118c85-b079-4c51-87ec-099389ee7be3/ffff950704c57800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789050038.048112:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789050038.048855:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789050038.048897:0:6671:0:(import.c:65:import_set_state_nolock()) ffff950704c52800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050038.049014:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691499392:12345-192.168.206.1@tcp:8:bash.0 Request processed in 1005us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050038.049022:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:0.0:1789050038.054697:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.054820:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499520 00000100:00100000:1.0:1789050038.054829:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499520 00000100:00100000:1.0:1789050038.054901:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:1.0:1789050038.054911:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:0:x1875954691499520:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050038.054927:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.054949:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f825 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050038.055003:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050038.055034:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:1.0:1789050038.055040:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050038.055049:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.055076:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.055110:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f600, rc 0) 00000100:00100000:1.0:1789050038.055173:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:0:x1875954691499520:12345-192.168.206.1@tcp:101:bash.0 Request processed in 263us (484us total) trans 0 rc 0/0 00000100:00080000:0.0:1789050038.055524:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050038.055582:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:0.0:1789050038.068619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.068793:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499648 00000100:00100000:1.0:1789050038.068803:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499648 00000100:00100000:1.0:1789050038.068859:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:1.0:1789050038.068870:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:10271:x1875954691499648:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050038.068886:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.068904:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f82c expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.068935:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.068944:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050038.068948:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050038.068953:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.068985:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.068998:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050038.069041:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704114944:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050038.069182:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050038.077619:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.077989:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704114944:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050038.078021:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.078040:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e400, rc 0) 00000100:00100000:0.0:1789050038.078112:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:10271:x1875954691499648:12345-192.168.206.1@tcp:101:bash.0 Request processed in 9243us (9500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.078121:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:3.0:1789050038.078597:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691499776 00000100:00100000:3.0:1789050038.078606:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691499776 00010000:00010000:3.0:1789050038.078638:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.078675:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:3.0:1789050038.078684:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691499776:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050038.078723:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050038.078750:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.078763:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.078790:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b78d8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f825 expref: 8 pid: 8215 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.078812:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050038.078816:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050038.078824:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.078833:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.078866:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.078880:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5802:1875954704115072:192.168.206.1@tcp:105: 00000100:00100000:3.0:1789050038.078945:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050038.083464:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.083707:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5802:1875954704115072:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050038.083739:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050038.083828:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691499776:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 5144us (6218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.083838:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:0.0:1789050038.083970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691500032 00000100:00100000:0.0:1789050038.083977:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691500032 00000100:00100000:0.0:1789050038.084032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:0.0:1789050038.084041:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+12:10271:x1875954691500032:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:0.0:1789050038.084326:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:0.0:1789050038.084412:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:10271:x1875954691500032:12345-192.168.206.1@tcp:35:bash.0 Request processed in 372us (956us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789050038.084419:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000020:00080000:0.0:1789050038.084423:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050038.205371:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.205502:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691500288 00000100:00100000:3.0:1789050038.205512:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691500288 00000100:00100000:3.0:1789050038.205575:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:3.0:1789050038.205585:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:10281:x1875954691500288:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050038.205607:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050038.205626:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f833 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050038.205730:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789050038.205834:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78d99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f833 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.205847:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:3.0:1789050038.205850:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050038.205855:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f833 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.205870:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd24400, rc 0) 00000100:00100000:3.0:1789050038.205936:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:10281:x1875954691500288:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 351us (572us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1789050038.205943:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:2.0:1789050038.209324:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.209488:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691500544 00000100:00100000:0.0:1789050038.209496:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691500544 00000100:00100000:0.0:1789050038.209551:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050038.209560:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:10281:x1875954691500544:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050038.209875:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+16:10281:x1875954691500544:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 315us (560us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789050038.209883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050038.273574:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.273675:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691500672 00000100:00100000:1.0:1789050038.273696:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691500672 00000100:00100000:1.0:1789050038.273758:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:1.0:1789050038.273768:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+16:10287:x1875954691500672:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050038.273789:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.273808:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78da7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f83a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.273868:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.273881:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.273891:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050038.273923:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789050038.273927:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050038.273946:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.273969:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78da7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f83a expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.273987:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f83a expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.274020:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050038.274024:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050038.274028:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789050038.274083:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+17:10287:x1875954691500672:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 316us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.274090:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:2.0:1789050038.278944:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.286164:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691500928 00000100:00100000:3.0:1789050038.286177:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691500928 00000100:00100000:2.0:1789050038.286406:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:2.0:1789050038.286419:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+17:10287:x1875954691500928:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050038.286441:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050038.286460:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78db5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f841 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.286552:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.286565:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.286576:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050038.286588:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789050038.286704:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78db5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f841 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.286734:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f841 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.286759:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:2.0:1789050038.286762:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050038.286765:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050038.286830:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:10287:x1875954691500928:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 414us (7900us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789050038.286838:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:2.0:1789050038.290245:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.290342:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501184 00000100:00100000:1.0:1789050038.290350:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501184 00000100:00100000:1.0:1789050038.290408:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:1.0:1789050038.290419:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:10287:x1875954691501184:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050038.290441:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.290459:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f848 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.290546:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.290561:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.290573:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050038.290585:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789050038.290706:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f848 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.290751:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f848 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.290759:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:1.0:1789050038.290762:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789050038.290766:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f600, rc 0) 00000100:00100000:1.0:1789050038.290922:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:10287:x1875954691501184:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 504us (684us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789050038.290929:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:2.0:1789050038.293088:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.293611:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501312 00000100:00100000:1.0:1789050038.293619:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501312 00000100:00100000:1.0:1789050038.293672:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:1.0:1789050038.293692:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:2348:x1875954691501312:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050038.293706:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050038.293737:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f841 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.293754:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:1.0:1789050038.293759:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050038.293802:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:2348:x1875954691501312:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 122us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.293810:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:0.0:1789050038.304473:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.304669:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501440 00000100:00100000:3.0:1789050038.304678:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501440 00000100:00100000:3.0:1789050038.308030:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:3.0:1789050038.308066:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691501440:12345-192.168.206.1@tcp:1:lfs.0 00010000:00010000:3.0:1789050038.308111:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.308131:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.308140:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050038.308169:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050038.308174:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.308237:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.308252:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 7 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.308267:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1875954704115200:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050038.308418:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704e98840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050038.312363:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1875954704115200:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050038.312392:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.312517:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.312679:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501568 00000100:00100000:2.0:1789050038.312687:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501568 00002000:00100000:2.0:1789050038.312740:0:6676:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff950707e6c700 x1875954691501568/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:539/0 lens 504/0 e 0 to 0 dl 1789050049 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050038.312751:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950707e6c700 with x1875954691501568 ext(0->12) 00010000:00010000:2.0:1789050038.312757:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 8 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.312770:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 8 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050038.312778:0:6676:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff950707e6c700 00000100:00100000:2.0:1789050038.312808:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:2.0:1789050038.312819:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691501568:12345-192.168.206.1@tcp:4:lfs.0 00000001:00100000:2.0:1789050038.375866:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000100:00100000:0.0:1789050038.376873:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691501568:12345-192.168.206.1@tcp:4:lfs.0 Request processed in 64051us (64351us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789050038.376889:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00002000:00100000:0.0:1789050038.376911:0:6676:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff950707e6c700 x1875954691501568/t4294967299(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:539/0 lens 504/448 e 0 to 0 dl 1789050049 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050038.376921:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950707e6c700 with x1875954691501568 ext(0->12) 00010000:00010000:0.0:1789050038.376931:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.376949:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050038.376957:0:6676:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff950707e6c700 00000100:00100000:2.0:1789050038.388816:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.389066:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501696 00000100:00100000:3.0:1789050038.389075:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501696 00010000:00010000:3.0:1789050038.389112:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.390575:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050038.390590:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691501696:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050038.390606:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789050038.390624:0:5802:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789050038.390627:0:5802:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789050038851430492 00002000:00010000:3.0:1789050038.390629:0:5802:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789050039069446135 00002000:00010000:3.0:1789050038.390632:0:5802:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789050038851430492 00010000:00010000:3.0:1789050038.390638:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.390663:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.390684:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad5ce27/0x9df728c939b78d92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f82c expref: 9 pid: 6672 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.390700:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050038.390704:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050038.390721:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.390731:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.390762:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050038.390813:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691501696:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 228us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.390820:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00010000:00010000:0.0:1789050038.391126:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391136:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391158:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391165:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391173:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391179:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050038.391190:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391221:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391237:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.391245:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6374808/0x9df728c939b78ddf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.391315:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691501440:12345-192.168.206.1@tcp:1:lfs.0 Request processed in 83272us (86849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.391322:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050038.399953:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.400030:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691501952 00000100:00100000:3.0:1789050038.400044:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691501952 00000100:00100000:3.0:1789050038.400098:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:3.0:1789050038.400108:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:10287:x1875954691501952:12345-192.168.206.1@tcp:35:lfs.0 00000004:00010000:3.0:1789050038.400166:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f848 expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050038.400476:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789050038.400520:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789050038.400987:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1789050038.401035:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.401050:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.401059:0:5820:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.401090:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.401105:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 24 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.401119:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875954704115328:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050038.401237:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050038.403524:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875954704115328:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050038.403550:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050038.408058:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.408156:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691502080 00000100:00100000:1.0:1789050038.408165:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691502080 00010000:00010000:1.0:1789050038.408238:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 25 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050038.408292:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:1.0:1789050038.408302:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+25:2348:x1875954691502080:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050038.408317:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050038.408324:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 25 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408336:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 25 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408356:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f81e expref: 25 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408372:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:1.0:1789050038.408377:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408386:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408394:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.408425:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050038.408475:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+24:2348:x1875954691502080:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 174us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.408483:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00010000:00010000:2.0:1789050038.408669:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.408679:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050038.408803:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1789050038.408988:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789050038.409106:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704115456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050038.409149:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050038.409186:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050038.409381:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115456 00000100:00100000:0.0:1789050038.409387:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115456 00000100:00100000:0.0:1789050038.409439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050038.409449:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875954704115456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789050038.409527:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875954704115456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.409534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050038.409578:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704115456:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789050038.409597:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789050038.410175:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789050038.410256:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704115584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050038.410291:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050038.410319:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050038.410373:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115584 00000100:00100000:0.0:1789050038.410379:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115584 00000100:00100000:0.0:1789050038.410415:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050038.410423:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1875954704115584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789050038.410585:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5820:x1875954704115584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (292us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789050038.410600:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050038.411894:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704115584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789050038.411964:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789050038.412010:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412021:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412037:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412043:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050038.412047:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412055:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412069:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:2.0:1789050038.412072:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789050038.412076:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050038.412083:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78de6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050038.412267:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789050038.412471:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789050038.412483:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274400282507ns, next at 275400280567ns, rc = 0 00000001:00080000:2.0:1789050038.412489:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789050038.412520:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc000) 00010000:00010000:2.0:1789050038.412523:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789050038.412530:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b78dd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f848 expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050038.412687:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:10287:x1875954691501952:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 12580us (12741us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789050038.412719:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000020:00080000:2.0:1789050038.412725:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:1.0:1789050038.413960:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050038.420431:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.420813:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691502208 00000100:00100000:0.0:1789050038.420823:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691502208 00000100:00100000:0.0:1789050038.420880:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:0.0:1789050038.420890:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:10287:x1875954691502208:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050038.420910:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050038.420931:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b78ded lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f84f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.420982:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b78ded lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f84f expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.420996:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b78ded lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f84f expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.421013:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050038.421016:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050038.421019:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330a00, rc 0) 00000100:00100000:0.0:1789050038.421077:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+28:10287:x1875954691502208:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 188us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.421084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:0.0:1789050038.429357:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.431083:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691502464 00000100:00100000:3.0:1789050038.431095:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691502464 00000100:00100000:3.0:1789050038.431157:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789050038.431167:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+28:10287:x1875954691502464:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050038.431810:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:10287:x1875954691502464:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 641us (2458us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789050038.431819:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050038.509252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.517351:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691502720 00000100:00100000:1.0:1789050038.517365:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691502720 00000100:00100000:1.0:1789050038.517436:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:1.0:1789050038.517446:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:10297:x1875954691502720:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050038.517470:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.517489:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f856 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050038.517571:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789050038.517674:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78df4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f856 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.517689:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:1.0:1789050038.517691:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050038.517697:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f856 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.517721:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e600, rc 0) 00000100:00100000:1.0:1789050038.517784:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+30:10297:x1875954691502720:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 339us (8540us total) trans 4294967328 rc 301/301 00000100:00100000:1.0:1789050038.517791:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:2.0:1789050038.528167:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.528289:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691502848 00000100:00100000:0.0:1789050038.528312:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691502848 00000100:00100000:0.0:1789050038.528373:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:0.0:1789050038.528383:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+30:10297:x1875954691502848:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:0.0:1789050038.528453:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528469:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528481:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528497:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528503:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528509:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528589:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528595:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528601:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050038.528638:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528659:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528665:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528671:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528677:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050038.528681:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528687:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528697:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050038.528700:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050038.528704:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528722:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b78e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528735:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528741:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528746:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528756:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050038.528759:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528765:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528772:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950714b52700) 00010000:00010000:0.0:1789050038.528774:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050038.528777:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528782:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528794:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528799:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528805:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528810:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050038.528812:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528818:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528835:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050038.528837:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050038.528840:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.528845:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b78e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.528916:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+30:10297:x1875954691502848:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 533us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.528923:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:0.0:1789050038.530927:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.531007:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691503104 00000100:00100000:2.0:1789050038.531015:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691503104 00000100:00100000:2.0:1789050038.531066:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050038.531075:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+30:10297:x1875954691503104:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050038.531315:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+31:10297:x1875954691503104:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 240us (394us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789050038.531322:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050038.574010:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.574103:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691503360 00000100:00100000:1.0:1789050038.574112:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691503360 00000100:00100000:1.0:1789050038.574167:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:1.0:1789050038.574177:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+31:10300:x1875954691503360:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050038.574322:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050038.574342:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78e17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f85d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574427:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574441:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574452:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574464:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574471:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574477:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574579:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574588:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574595:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050038.574604:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789050038.574681:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574688:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574701:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574720:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050038.574725:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574733:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574744:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050038.574747:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050038.574751:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574758:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78e1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574772:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574777:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574783:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574787:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050038.574790:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574807:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574815:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950732cb4d00) 00010000:00010000:1.0:1789050038.574817:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050038.574820:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574826:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574869:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78e17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574883:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.574890:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050038.574892:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050038.574894:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f000, rc 0) 00000100:00100000:1.0:1789050038.574997:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+33:10300:x1875954691503360:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 820us (994us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789050038.575005:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:3.0:1789050038.580611:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.580717:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691503488 00000100:00100000:0.0:1789050038.580726:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691503488 00000100:00100000:0.0:1789050038.580785:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:0.0:1789050038.580796:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+33:10300:x1875954691503488:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:0.0:1789050038.580856:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580873:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580885:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580908:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580915:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580935:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580940:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050038.580944:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580952:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580963:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050038.580967:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050038.580971:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.580978:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b78e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.581103:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+33:10300:x1875954691503488:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 308us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.581111:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:0.0:1789050038.585338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.585410:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691503744 00000100:00100000:2.0:1789050038.585419:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691503744 00000100:00100000:2.0:1789050038.585467:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050038.585476:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+33:10300:x1875954691503744:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050038.585684:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+34:10300:x1875954691503744:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 208us (490us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789050038.585691:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050038.800414:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.800603:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691504000 00000100:00100000:3.0:1789050038.800612:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691504000 00000100:00100000:3.0:1789050038.800716:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:3.0:1789050038.800726:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+34:10331:x1875954691504000:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:3.0:1789050038.800749:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050038.800768:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f864 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.800858:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.800872:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.800884:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050038.800895:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789050038.801029:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f864 expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.801049:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f864 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.801057:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050038.801060:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050038.801064:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25200, rc 0) 00000100:00100000:3.0:1789050038.801140:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+36:10331:x1875954691504000:12345-192.168.206.1@tcp:101:cat.0 Request processed in 414us (733us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789050038.801147:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:2.0:1789050038.810806:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050038.810850:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050038.810933:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691504128 00000100:00100000:1.0:1789050038.810942:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691504128 00000100:00100000:1.0:1789050038.811009:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:1.0:1789050038.811019:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:2347:x1875954691504128:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050038.811049:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050038.811073:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f864 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.811090:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050038.811095:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050038.811147:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+35:2347:x1875954691504128:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.811155:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:3.0:1789050038.813328:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691504384 00000100:00100000:3.0:1789050038.813354:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691504384 00000100:00100000:3.0:1789050038.813412:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:3.0:1789050038.813422:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+35:10331:x1875954691504384:12345-192.168.206.1@tcp:35:cat.0 00000100:00100000:3.0:1789050038.813965:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:10331:x1875954691504384:12345-192.168.206.1@tcp:35:cat.0 Request processed in 543us (3112us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789050038.813973:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:2.0:1789050038.877426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050038.877521:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691504640 00000100:00100000:0.0:1789050038.877530:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691504640 00000100:00100000:0.0:1789050038.877602:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:0.0:1789050038.877613:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:10337:x1875954691504640:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:0.0:1789050038.877635:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050038.877638:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050038.877664:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b78dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f83a expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877697:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050038.877703:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050038.877727:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78e56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f86b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877820:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877834:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877841:0:5817:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877875:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.877888:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 36 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.877900:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704115712:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050038.877992:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050038.881325:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.881457:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691504768 00000100:00100000:3.0:1789050038.881467:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691504768 00010000:00010000:3.0:1789050038.881519:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 37 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.881564:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:3.0:1789050038.881575:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+37:2347:x1875954691504768:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050038.881588:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050038.881594:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 37 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.881607:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 37 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.881629:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050038.881635:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.881645:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.881665:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.882114:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050038.882171:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+37:2347:x1875954691504768:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 597us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.882180:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00010000:00010000:0.0:1789050038.882563:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b78e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f85d expref: 36 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.882594:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704115712:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050038.882627:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.882637:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.882644:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050038.882662:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789050038.882830:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78e56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.882845:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050038.882853:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050038.882856:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050038.882859:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:0.0:1789050038.882902:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:10337:x1875954691504640:12345-192.168.206.1@tcp:101:dd.0 Request processed in 5292us (5484us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789050038.882909:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:2.0:1789050038.888728:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050038.888965:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505024 00000100:00100000:3.0:1789050038.888975:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505024 00000100:00100000:3.0:1789050038.889033:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:3.0:1789050038.889044:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+36:10337:x1875954691505024:12345-192.168.206.1@tcp:36:dd.0 00010000:00010000:3.0:1789050038.889419:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.889434:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050038.889445:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050038.889506:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1789050038.889532:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002014bc12 reply state 000000002e390eee transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050038.889541:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050038.889791:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+39:10337:x1875954691505024:12345-192.168.206.1@tcp:36:dd.0 Request processed in 748us (1070us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789050038.889799:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00000020:00080000:3.0:1789050038.889804:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050038.898982:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.898997:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.899004:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.899011:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050038.899015:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.899022:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.899036:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050038.899039:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050038.899043:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050038.899066:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050038.924759:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704116224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.924824:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050038.924859:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050038.924865:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704116096:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.924891:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050038.925010:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116096 00000100:00100000:1.0:1789050038.925016:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116096 00000100:00100000:1.0:1789050038.925072:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789050038.925080:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704116096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050038.925130:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704116096:12345-0@lo:400:kworker.0 Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050038.925136:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789050038.925180:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704116096:0@lo:400:kworker.0 00000100:00080000:0.0:1789050038.925363:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050038.925553:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704115968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.925591:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.925668:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789050038.925675:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704115840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.925702:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.925746:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704116352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.925767:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050038.925920:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115968 00000100:00100000:3.0:1789050038.925925:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115968 00000100:00100000:3.0:1789050038.925948:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116352 00000100:00100000:3.0:1789050038.925950:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116352 00000100:00100000:3.0:1789050038.925984:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050038.925990:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.926027:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704115968:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.926033:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789050038.926045:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789050038.926051:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704116352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.926074:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704116352:12345-0@lo:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050038.926079:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789050038.926104:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704116352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050038.926114:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704115968:0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.926480:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704115840 00000100:00100000:0.0:1789050038.926485:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704115840 00000100:00100000:0.0:1789050038.926520:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789050038.926528:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704115840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050038.926567:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704115840:12345-0@lo:400:kworker.0 Request processed in 40us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050038.926584:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:0.0:1789050038.926607:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050038.926624:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704115840:0@lo:400:kworker.0 00000100:00100000:2.0:1789050038.927066:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116224 00000100:00100000:2.0:1789050038.927071:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116224 00000100:00100000:2.0:1789050038.927107:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789050038.927113:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704116224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050038.927154:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704116224:12345-0@lo:400:kworker.0 Request processed in 41us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050038.927159:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789050038.927173:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050038.927781:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704116224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050039.135558:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.135793:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505152 00000100:00100000:3.0:1789050039.135803:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505152 00000100:00100000:3.0:1789050039.135866:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:3.0:1789050039.135876:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+38:10351:x1875954691505152:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:3.0:1789050039.135898:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050039.135928:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f872 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.135991:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136004:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136018:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136044:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136053:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136060:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136136:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136146:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136154:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136187:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.136244:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 39 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050039.136257:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704116480:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050039.136347:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789050039.140441:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950707e6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704116480:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050039.140467:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050039.146451:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.147524:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505408 00000100:00100000:3.0:1789050039.147535:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505408 00000100:00100000:3.0:1789050039.147594:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050039.147603:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+40:5588:x1875954691505408:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789050039.147944:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+41:5588:x1875954691505408:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 341us (1502us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789050039.147952:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050039.152575:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.152675:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505536 00000100:00100000:2.0:1789050039.152684:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505536 00010000:00010000:2.0:1789050039.152742:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 41 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050039.152780:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789050039.152789:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+41:2348:x1875954691505536:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050039.152803:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050039.152809:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 41 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152822:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 41 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152842:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b78e5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f86b expref: 41 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152858:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050039.152876:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152886:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152893:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.152926:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050039.152988:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+40:2348:x1875954691505536:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 199us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050039.152995:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00010000:00010000:0.0:1789050039.153189:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153226:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050039.153271:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789050039.153275:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050039.153321:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153335:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153343:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153360:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153365:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153371:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050039.153375:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153383:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153392:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050039.153395:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050039.153399:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153404:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153416:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153422:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153427:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153431:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050039.153439:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153446:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153454:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9507114dc300) 00010000:00010000:0.0:1789050039.153456:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050039.153459:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153465:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78e80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153500:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78e72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f872 expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153513:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f872 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.153519:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050039.153521:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050039.153524:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25e00, rc 0) 00000100:00100000:0.0:1789050039.153556:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+39:10351:x1875954691505152:12345-192.168.206.1@tcp:101:stat.0 Request processed in 17682us (18007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050039.153563:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:3.0:1789050039.222533:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050039.222680:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505792 00000100:00100000:1.0:1789050039.222689:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505792 00000100:00100000:1.0:1789050039.222765:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050039.222775:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+39:10357:x1875954691505792:12345-192.168.206.1@tcp:36:truncate.0 00010000:00010000:1.0:1789050039.222828:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050039.222851:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f872 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.222871:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050039.222876:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050039.223110:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.223123:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.223146:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050039.223244:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1789050039.223272:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000f406f69 reply state 000000005223125b transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050039.223463:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050039.223558:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+41:10357:x1875954691505792:12345-192.168.206.1@tcp:36:truncate.0 Request processed in 784us (1035us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789050039.223566:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00000020:00080000:1.0:1789050039.223570:0:8158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050039.225919:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.225934:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.225942:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.225948:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050039.225953:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.225961:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.225975:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050039.225978:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050039.225997:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.226003:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78e8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050039.390626:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050039.390978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691505920 00000100:00100000:0.0:1789050039.390989:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691505920 00000100:00100000:0.0:1789050039.391053:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:0.0:1789050039.391063:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+40:10371:x1875954691505920:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:0.0:1789050039.391098:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050039.391117:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f879 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391173:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391186:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391228:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391405:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391415:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391422:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391502:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391509:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391516:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050039.391548:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789050039.391559:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050039.391581:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391592:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391600:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391607:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391613:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391619:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050039.391623:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391630:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391640:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050039.391643:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050039.391647:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391653:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b78e9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391665:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391681:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391687:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391692:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050039.391695:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391700:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391723:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950714b52700) 00010000:00010000:0.0:1789050039.391725:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050039.391728:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391733:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b78ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391763:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b78e95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391775:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050039.391982:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050039.391985:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050039.391993:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:0.0:1789050039.392166:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+41:10371:x1875954691505920:12345-192.168.206.1@tcp:101:stat.0 Request processed in 1102us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050039.392173:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 55 00010000:00010000:0.0:1789050039.435612:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050039.436337:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1789050039.439168:0:7944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 275426965958ns, next at 276426963388ns, rc = 0 00000100:00100000:2.0:1789050039.446402:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704116608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050039.446477:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050039.446640:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704116608 00000100:00100000:1.0:1789050039.446648:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704116608 00000100:00100000:1.0:1789050039.446720:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789050039.446730:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704116608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050039.446754:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050039.446815:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704116608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050039.446822:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050039.447376:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950702d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704116608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050039.488385:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050039.488808:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691506176 00000100:00100000:1.0:1789050039.488818:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691506176 00000100:00100000:1.0:1789050039.488921:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:1.0:1789050039.488931:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+41:10381:x1875954691506176:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050039.488951:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050039.488981:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78eb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f880 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050039.489074:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789050039.489233:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78eb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f880 expref: 43 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.489247:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:1.0:1789050039.489255:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050039.489261:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b78eb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f880 expref: 43 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.489288:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e200, rc 0) 00000100:00100000:1.0:1789050039.489346:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+42:10381:x1875954691506176:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 416us (969us total) trans 4294967340 rc 301/301 00000100:00100000:1.0:1789050039.489353:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:1.0:1789050039.492308:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.492584:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691506432 00000100:00100000:3.0:1789050039.492594:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691506432 00000100:00100000:3.0:1789050039.492644:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:3.0:1789050039.492654:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+42:10381:x1875954691506432:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050039.492912:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+43:10381:x1875954691506432:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 258us (610us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789050039.492920:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789050039.548829:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.548887:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691506688 00000100:00100000:3.0:1789050039.548896:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691506688 00000100:00100000:3.0:1789050039.548964:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:3.0:1789050039.548973:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+43:10388:x1875954691506688:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050039.548996:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050039.549111:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78ebf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f887 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.549252:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.549266:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.549283:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.549313:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.549325:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 44 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050039.549338:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704116736:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050039.549421:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050039.552821:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704116736:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050039.552846:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050039.553954:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050039.554995:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691506816 00000100:00100000:1.0:1789050039.555005:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691506816 00010000:00010000:1.0:1789050039.555041:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 45 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050039.555078:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:1.0:1789050039.555091:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+45:2347:x1875954691506816:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050039.555109:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050039.555116:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 45 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555129:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 45 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555150:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b78eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f879 expref: 45 pid: 5817 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555166:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050039.555172:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555192:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555287:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.555314:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050039.555361:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050039.555364:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+44:2347:x1875954691506816:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 276us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050039.555376:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00010000:00010000:3.0:1789050039.555381:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050039.555402:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789050039.555562:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78ebf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 45 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.555580:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.555588:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.555590:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050039.555593:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25e00, rc 0) 00000100:00100000:3.0:1789050039.555619:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+44:10388:x1875954691506688:12345-192.168.206.1@tcp:101:bash.0 Request processed in 6647us (6799us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789050039.555626:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:0.0:1789050039.562534:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050039.563989:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507072 00000100:00100000:1.0:1789050039.564003:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507072 00000100:00100000:1.0:1789050039.564335:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:1.0:1789050039.564346:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+44:10388:x1875954691507072:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:1.0:1789050039.564585:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.564601:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050039.564614:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050039.564661:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1789050039.564686:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d4fd7858 reply state 00000000371a8a2f transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050039.564695:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050039.564802:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+47:10388:x1875954691507072:12345-192.168.206.1@tcp:36:bash.0 Request processed in 457us (2275us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789050039.564823:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 58 00000020:00080000:1.0:1789050039.564828:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789050039.566590:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566603:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566610:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566616:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050039.566620:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566642:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566656:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.566659:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050039.566665:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.566671:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78ed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050039.571474:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.571547:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507200 00000100:00100000:2.0:1789050039.571558:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507200 00000100:00100000:2.0:1789050039.571607:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:2.0:1789050039.571629:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+46:10388:x1875954691507200:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050039.571651:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050039.571671:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f88e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.571759:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.571785:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 47 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.571794:0:5817:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.571825:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 47 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.571838:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 47 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050039.571855:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704116864:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050039.571930:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507205ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050039.576483:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704116864:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050039.576576:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050039.576762:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.576859:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507328 00000100:00100000:3.0:1789050039.576868:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507328 00010000:00010000:3.0:1789050039.576969:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 48 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050039.577042:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:3.0:1789050039.577053:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+48:2348:x1875954691507328:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050039.577065:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050039.577071:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 48 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577082:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 48 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577114:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ec6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f887 expref: 48 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577147:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.577152:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577161:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577169:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.577196:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050039.577288:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+47:2348:x1875954691507328:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 225us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.577296:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00010000:00010000:2.0:1789050039.578066:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.578076:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050039.578122:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789050039.578126:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050039.578145:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.578192:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f88e expref: 47 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.578230:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f88e expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.578238:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050039.578241:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050039.578244:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050039.578336:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+46:10388:x1875954691507200:12345-192.168.206.1@tcp:101:bash.0 Request processed in 6709us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050039.578344:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:1.0:1789050039.586487:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.586749:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507584 00000100:00100000:3.0:1789050039.586758:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507584 00000100:00100000:3.0:1789050039.586811:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050039.586823:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+46:10388:x1875954691507584:12345-192.168.206.1@tcp:35:bash.0 00000100:00100000:3.0:1789050039.587036:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+47:10388:x1875954691507584:12345-192.168.206.1@tcp:35:bash.0 Request processed in 215us (558us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789050039.587044:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:0.0:1789050039.646168:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.646618:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507840 00000100:00100000:2.0:1789050039.646629:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507840 00000100:00100000:2.0:1789050039.646689:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:2.0:1789050039.646699:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+47:10398:x1875954691507840:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050039.646730:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050039.646749:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f895 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050039.646829:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789050039.646940:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ee9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f895 expref: 49 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.646953:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:2.0:1789050039.646957:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050039.646969:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f895 expref: 49 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.646983:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050039.647060:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+48:10398:x1875954691507840:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 362us (900us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1789050039.647067:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:0.0:1789050039.650661:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.650974:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691507968 00000100:00100000:3.0:1789050039.650983:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691507968 00000100:00100000:3.0:1789050039.651127:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:3.0:1789050039.651138:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+48:10398:x1875954691507968:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050039.651376:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651404:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651416:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651431:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651438:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651444:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651520:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651527:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651534:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050039.651569:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651581:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651587:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651603:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651610:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050039.651678:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651694:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651714:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050039.651717:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050039.651722:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651729:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78ef7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651741:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651747:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651754:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651758:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050039.651761:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651778:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651786:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9507114dc500) 00010000:00010000:3.0:1789050039.651788:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050039.651791:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651796:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78efe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651810:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651816:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651821:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651826:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050039.651829:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651835:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651841:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.651843:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050039.651845:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.651859:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050039.651964:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+48:10398:x1875954691507968:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 827us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.651971:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:3.0:1789050039.657543:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050039.657937:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691508224 00000100:00100000:0.0:1789050039.657948:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691508224 00000100:00100000:0.0:1789050039.658039:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050039.658048:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+48:10398:x1875954691508224:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050039.658512:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+49:10398:x1875954691508224:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 464us (977us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789050039.658521:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050039.705539:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.705640:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691508480 00000100:00100000:2.0:1789050039.705650:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691508480 00000100:00100000:2.0:1789050039.705719:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:2.0:1789050039.705729:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+49:10401:x1875954691508480:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050039.705751:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050039.705770:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f89c expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705833:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705846:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705856:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705870:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705876:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.705882:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706020:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706030:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706036:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050039.706045:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789050039.706134:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706142:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706149:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706155:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050039.706159:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706167:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706178:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050039.706181:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050039.706185:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706246:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b78f13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706260:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706266:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706272:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706544:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050039.706549:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706555:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706564:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1300) 00010000:00010000:2.0:1789050039.706567:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050039.706570:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706576:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706619:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f89c expref: 52 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706632:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f89c expref: 51 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.706646:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050039.706649:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050039.706651:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:2.0:1789050039.706721:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+51:10401:x1875954691508480:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 994us (1190us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789050039.706729:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:1.0:1789050039.712400:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.712469:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691508608 00000100:00100000:2.0:1789050039.712487:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691508608 00000100:00100000:2.0:1789050039.712548:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789050039.712562:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+51:2348:x1875954691508608:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050039.712577:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050039.712600:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f89c expref: 51 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.712618:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050039.712623:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050039.712675:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+50:2348:x1875954691508608:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050039.712683:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050039.714546:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.714617:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691508736 00000100:00100000:2.0:1789050039.714625:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691508736 00000100:00100000:2.0:1789050039.714676:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:2.0:1789050039.714686:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:10401:x1875954691508736:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050039.715848:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715886:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715898:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715932:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715940:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715946:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715952:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050039.715956:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715963:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715974:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050039.715977:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050039.715982:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.715989:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050039.717103:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:10401:x1875954691508736:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 2412us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050039.717124:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:0.0:1789050039.723566:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.723649:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691508992 00000100:00100000:3.0:1789050039.723658:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691508992 00000100:00100000:3.0:1789050039.724276:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:3.0:1789050039.724286:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:10401:x1875954691508992:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050039.724502:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+51:10401:x1875954691508992:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 217us (945us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789050039.724510:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:1.0:1789050039.856826:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.856922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691509248 00000100:00100000:3.0:1789050039.856932:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691509248 00000100:00100000:3.0:1789050039.856993:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050039.857003:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+51:10419:x1875954691509248:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:3.0:1789050039.857037:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050039.857056:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.857154:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.857168:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.857193:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050039.857233:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789050039.857350:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8a3 expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.857369:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8a3 expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.857378:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.857381:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050039.857384:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd24400, rc 0) 00000100:00100000:3.0:1789050039.857447:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+53:10419:x1875954691509248:12345-192.168.206.1@tcp:101:cat.0 Request processed in 445us (631us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789050039.857455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:1.0:1789050039.895064:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.895273:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691509376 00000100:00100000:3.0:1789050039.895283:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691509376 00000100:00100000:3.0:1789050039.895351:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:3.0:1789050039.895361:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+53:10420:x1875954691509376:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050039.895383:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050039.895401:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8aa expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895578:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895607:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895619:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050039.895654:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789050039.895658:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050039.895675:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895711:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8aa expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895731:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8aa expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.895740:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050039.895743:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050039.895746:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bd25e00, rc 0) 00000100:00100000:3.0:1789050039.895904:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:10420:x1875954691509376:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 543us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.895911:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:0.0:1789050039.912320:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.912515:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691509760 00000100:00100000:2.0:1789050039.912525:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691509760 00000100:00100000:2.0:1789050039.912580:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:2.0:1789050039.912590:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+54:10420:x1875954691509760:12345-192.168.206.1@tcp:35:lfs.0 00000001:00080000:2.0:1789050039.912855:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000100:00100000:2.0:1789050039.912960:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:10420:x1875954691509760:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 371us (648us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789050039.912968:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000020:00080000:2.0:1789050039.912972:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050039.915378:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.915462:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691509888 00000100:00100000:3.0:1789050039.915471:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691509888 00000100:00100000:3.0:1789050039.915531:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050039.915541:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:10420:x1875954691509888:12345-192.168.206.1@tcp:103:lfs.0 00010000:00010000:3.0:1789050039.915555:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789050039.915592:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b78ee2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f88e expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.915626:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8a3 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.915640:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b78ded lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f84f expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.915650:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050039.915659:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050039.915716:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+53:10420:x1875954691509888:12345-192.168.206.1@tcp:103:lfs.0 Request processed in 176us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.915724:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:1.0:1789050039.918483:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050039.922637:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510016 00000100:00100000:3.0:1789050039.922651:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510016 00000100:00100000:3.0:1789050039.922726:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:3.0:1789050039.922737:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+53:10420:x1875954691510016:12345-192.168.206.1@tcp:58:lfs.0 00010000:00010000:3.0:1789050039.922865:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.922881:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050039.922892:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050039.923151:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050039.923556:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789050039.923627:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789050039.923788:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+53:10420:x1875954691510016:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 1052us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050039.923797:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:0.0:1789050039.948089:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050039.948184:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510144 00000100:00100000:2.0:1789050039.948240:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510144 00000100:00100000:2.0:1789050039.948513:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:2.0:1789050039.948524:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+53:10422:x1875954691510144:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050039.948545:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050039.948564:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8b1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948627:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948641:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948652:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948666:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948688:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.948696:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949145:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949155:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949162:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050039.949388:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789050039.949394:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050039.949417:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949429:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949437:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949444:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949450:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949466:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050039.949470:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949478:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949489:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050039.949492:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050039.949496:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949502:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78f67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949514:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949520:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949525:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949530:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050039.949532:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949537:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949552:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1300) 00010000:00010000:2.0:1789050039.949555:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050039.949557:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949563:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949593:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b78f60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949605:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050039.949612:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:2.0:1789050039.949614:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050039.949616:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050039.949680:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+54:10422:x1875954691510144:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1158us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050039.949688:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:1.0:1789050040.016746:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.016786:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.016829:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.016928:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510272 00000100:00100000:3.0:1789050040.016937:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510272 00000100:00100000:3.0:1789050040.016995:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 277 00000100:00100000:3.0:1789050040.017005:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2347:x1875954691510272:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050040.017071:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2347:x1875954691510272:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 67us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.017078:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 277 00000100:00100000:2.0:1789050040.017683:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510528 00000100:00100000:2.0:1789050040.017689:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510528 00000100:00100000:2.0:1789050040.017753:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:2.0:1789050040.017761:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691510528:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050040.017805:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2347:x1875954691510528:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 45us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.017812:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:0.0:1789050040.018429:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510400 00000100:00100000:0.0:1789050040.018435:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510400 00000100:00100000:0.0:1789050040.018476:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:0.0:1789050040.018486:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691510400:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050040.018536:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691510400:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 52us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050040.018543:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00080000:3.0:1789050040.018555:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050040.018562:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050040.464396:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050040.523677:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050040.523685:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050040.523748:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789050040.523755:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050040.523862:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c633480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704116992:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050040.523951:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050040.528614:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c633480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704116992:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789050040.532719:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.532882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510656 00000100:00100000:3.0:1789050040.532890:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510656 00000100:00100000:3.0:1789050040.532953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:3.0:1789050040.532964:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510656:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789050040.533034:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510656:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.533041:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00080000:1.0:1789050040.533232:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050040.540398:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.540653:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510784 00000100:00100000:3.0:1789050040.540662:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510784 00000100:00100000:3.0:1789050040.540731:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:3.0:1789050040.540742:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510784:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050040.540769:0:5819:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789050040.540867:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510784:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.540887:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:0.0:1789050040.547755:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.547825:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691510912 00000100:00100000:3.0:1789050040.547834:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691510912 00000100:00100000:3.0:1789050040.547888:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:3.0:1789050040.547898:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510912:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789050040.547965:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.547981:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.547993:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548049:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548058:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548064:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548088:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548096:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548102:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050040.548144:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789050040.548149:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050040.548160:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548170:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548177:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548182:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548188:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050040.548192:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548226:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548238:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:3.0:1789050040.548241:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050040.548246:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548251:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24a00/0x9df728c939b78f7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548263:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548290:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548297:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548302:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050040.548305:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548311:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548320:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9507114dc900) 00010000:00010000:3.0:1789050040.548322:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050040.548325:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548331:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25400/0x9df728c939b78f83 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548346:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548352:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548358:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548363:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd25200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050040.548371:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548378:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548385:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:3.0:1789050040.548387:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050040.548390:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.548396:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25200/0x9df728c939b78f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050040.548462:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691510912:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 565us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.548470:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:0.0:1789050040.552499:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.552737:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691511168 00000100:00100000:1.0:1789050040.552747:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691511168 00000100:00100000:1.0:1789050040.552801:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:1.0:1789050040.552811:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+54:10433:x1875954691511168:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050040.552828:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050040.552846:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78f91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8b8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.552944:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.552958:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.552978:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050040.552989:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789050040.553073:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553081:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553088:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553093:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050040.553098:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553105:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553116:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:1.0:1789050040.553119:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050040.553124:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553130:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78f98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553165:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78f91 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b8 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553185:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:1.0:1789050040.553187:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050040.553192:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78f91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b8 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.553233:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e600, rc 0) 00000100:00100000:1.0:1789050040.553285:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511168:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 475us (792us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789050040.553292:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:2.0:1789050040.558145:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.558689:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691511296 00000100:00100000:1.0:1789050040.558708:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691511296 00000100:00100000:1.0:1789050040.558767:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:1.0:1789050040.558776:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511296:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050040.558808:0:8158:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050040.559152:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511296:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 376us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050040.559160:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:3.0:1789050040.563145:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.563249:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691511552 00000100:00100000:1.0:1789050040.563258:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691511552 00000100:00100000:1.0:1789050040.563458:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:1.0:1789050040.563467:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511552:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050040.563488:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050040.563491:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789050040.563515:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd25e00/0x9df728c939b78f52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8aa expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.563542:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050040.563547:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050040.563560:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78fa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8bf expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789050040.563953:0:5819:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789050040.564157:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.564171:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.564182:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.564254:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b78fa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8bf expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.564284:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8bf expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.564292:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff950732cb4d00) 00010000:00010000:1.0:1789050040.564295:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050040.564298:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:1.0:1789050040.564351:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+56:10433:x1875954691511552:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 884us (1213us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789050040.564358:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:1.0:1789050040.581389:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.586529:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691511808 00000100:00100000:3.0:1789050040.586544:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691511808 00000100:00100000:3.0:1789050040.586637:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 73 00000100:00100000:3.0:1789050040.586649:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+56:10433:x1875954691511808:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050040.586710:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050040.586735:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b78fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8bf expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586756:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff950732cb4d00) 00010000:00010000:3.0:1789050040.586769:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050040.586791:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586810:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586820:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586873:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586882:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586889:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586946:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586954:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586961:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586967:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050040.586972:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586979:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.586988:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050040.587074:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050040.587079:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587086:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b78fbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587096:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587102:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587107:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587113:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050040.587115:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587121:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587129:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeee89b0 (ffff9507114dc900) 00010000:00010000:3.0:1789050040.587131:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050040.587134:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.587139:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b78fc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeee89b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050040.587237:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511808:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 589us (5855us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050040.587255:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 73 00000100:00100000:1.0:1789050040.595579:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.595679:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691511936 00000100:00100000:3.0:1789050040.595689:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691511936 00000100:00100000:3.0:1789050040.595748:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:3.0:1789050040.595757:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+55:10433:x1875954691511936:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050040.595775:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050040.595794:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b78fc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8c6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595824:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595836:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595847:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595929:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b78fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595944:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.595952:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:3.0:1789050040.595955:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050040.595958:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06000, rc 0) 00000100:00100000:3.0:1789050040.596049:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:10433:x1875954691511936:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 293us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.596062:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:3.0:1789050040.607128:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050040.607191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691512192 00000100:00100000:0.0:1789050040.607259:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691512192 00000100:00100000:0.0:1789050040.607314:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:0.0:1789050040.607325:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:10433:x1875954691512192:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050040.607419:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.607436:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.607448:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050040.607725:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789050040.607734:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276595534258ns, next at 277595532399ns, rc = 0 00000004:00010000:0.0:1789050040.607817:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c2e3eca7 reply state 000000007e771b22 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.607826:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050040.607915:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+58:10433:x1875954691512192:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 591us (794us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789050040.607929:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:2.0:1789050040.612328:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.612366:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691512320 00000100:00100000:2.0:1789050040.612375:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691512320 00000100:00100000:2.0:1789050040.612421:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:2.0:1789050040.612431:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+58:10433:x1875954691512320:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050040.612452:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050040.612471:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8cd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.612527:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.612542:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.612561:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:2.0:1789050040.612565:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050040.612568:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050040.612617:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+59:10433:x1875954691512320:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 187us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.612624:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 76 00010000:00010000:1.0:1789050040.612911:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612921:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612928:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612934:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050040.612938:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612945:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612956:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:1.0:1789050040.612959:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050040.612962:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.612969:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b78fd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.617691:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.618094:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691512448 00000100:00100000:3.0:1789050040.618103:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691512448 00000100:00100000:3.0:1789050040.618148:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:3.0:1789050040.618156:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875954691512448:12345-192.168.206.1@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789050040.618187:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1789050040.618354:0:6671:0:(genops.c:1384:class_connect()) connect: client 2c118c85-b079-4c51-87ec-099389ee7be3, cookie 0x9df728c939b78fe5 00002000:00100000:3.0:1789050040.618367:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2c118c85-b079-4c51-87ec-099389ee7be3/ffff950605aaf000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789050040.618389:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789050040.618637:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789050040.619839:0:6671:0:(import.c:65:import_set_state_nolock()) ffff950605aac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050040.619955:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2346:x1875954691512448:12345-192.168.206.1@tcp:8:lhsmtool_posix.0 Request processed in 1796us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050040.619966:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:1.0:1789050040.625238:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050040.625356:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691512576 00000100:00100000:0.0:1789050040.625366:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691512576 00000100:00100000:0.0:1789050040.625439:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:0.0:1789050040.625451:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:0:x1875954691512576:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789050040.625919:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050040.688705:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:0:x1875954691512576:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 63238us (63456us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789050040.688726:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 25 00000001:00080000:3.0:1789050040.688729:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1789050040.688745:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000040:00080000:3.0:1789050040.692521:0:11987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050040.692529:0:11987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050040.692579:0:11987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789050040.692586:0:11987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050040.695135:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.697782:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691512832 00000100:00100000:2.0:1789050040.697793:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691512832 00000100:00100000:2.0:1789050040.697837:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:2.0:1789050040.697852:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+58:10433:x1875954691512832:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789050040.698298:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+59:10433:x1875954691512832:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 445us (3166us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789050040.698308:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:2.0:1789050040.723422:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.723529:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513088 00000100:00100000:3.0:1789050040.723538:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513088 00000100:00100000:3.0:1789050040.723621:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:3.0:1789050040.723632:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+59:10433:x1875954691513088:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050040.723756:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+59:10433:x1875954691513088:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 125us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.723763:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:1.0:1789050040.726646:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.726977:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513216 00000100:00100000:2.0:1789050040.726985:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513216 00000100:00100000:2.0:1789050040.727165:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:2.0:1789050040.727176:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+59:10433:x1875954691513216:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050040.727193:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050040.727239:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8d4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727314:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727328:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727339:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050040.727373:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050040.727391:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727417:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b78fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8d4 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727446:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8d4 expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.727454:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:2.0:1789050040.727457:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789050040.727460:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050040.727512:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+60:10433:x1875954691513216:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 338us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.727520:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:1.0:1789050040.740641:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050040.742298:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513344 00000100:00100000:0.0:1789050040.742309:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513344 00000100:00100000:0.0:1789050040.742396:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:0.0:1789050040.742408:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691513344:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050040.742425:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050040.742444:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8db expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050040.742470:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb88a96f8140, blocks: 0x1 00010000:00010000:0.0:1789050040.742487:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1789050040.742491:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050040.742500:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.742519:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.742544:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331e00, rc 0) 00000100:00100000:0.0:1789050040.742610:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691513344:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 205us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050040.742618:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:3.0:1789050040.745399:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.745806:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513600 00000100:00100000:2.0:1789050040.745816:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513600 00000100:00100000:2.0:1789050040.745868:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:2.0:1789050040.745877:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+60:10433:x1875954691513600:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789050040.745970:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+60:10433:x1875954691513600:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 94us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.745978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:3.0:1789050040.751566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.751642:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513728 00000100:00100000:2.0:1789050040.751651:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513728 00000100:00100000:2.0:1789050040.751712:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050040.751722:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:10433:x1875954691513728:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050040.751738:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050040.751754:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8e2 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.751783:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.751800:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050040.751804:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050040.751810:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.751843:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.751857:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 7 pid: 6672 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.751870:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875954704117120:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050040.751988:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050040.756356:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.756388:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513856 00000100:00100000:1.0:1789050040.756396:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513856 00010000:00010000:1.0:1789050040.756430:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 8 pid: 6672 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.756460:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:1.0:1789050040.756468:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691513856:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050040.756481:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050040.756513:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 8 pid: 6672 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.756526:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 8 pid: 6672 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.756550:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050040.756554:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050040.756562:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.756570:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.756614:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.756627:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5801:1875954704117248:192.168.206.1@tcp:105: 00000100:00100000:1.0:1789050040.756690:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf60c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789050040.757088:0:8215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b78ffa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8db expref: 8 pid: 6672 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050040.757103:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875954704117120:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050040.757124:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.757134:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:3.0:1789050040.757175:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:10433:x1875954691513728:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 5455us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.757183:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050040.760935:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5801:1875954704117248:192.168.206.1@tcp:105: 00010000:00010000:2.0:1789050040.760958:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050040.761003:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691513856:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 4535us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.761018:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:2.0:1789050040.764806:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.765087:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691513984 00000100:00100000:3.0:1789050040.765097:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691513984 00002000:00100000:3.0:1789050040.765141:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff95073c19ed80 x1875954691513984/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:541/0 lens 504/0 e 0 to 0 dl 1789050051 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050040.765152:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c19ed80 with x1875954691513984 ext(0->8) 00002000:00010000:3.0:1789050040.765158:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c19ed80 00000100:00100000:3.0:1789050040.765180:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050040.765190:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691513984:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789050040.768583:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691513984:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 Request processed in 3388us (3780us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789050040.768595:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00002000:00100000:3.0:1789050040.768606:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff95073c19ed80 x1875954691513984/t4294967302(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:541/0 lens 504/448 e 0 to 0 dl 1789050051 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050040.768629:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c19ed80 with x1875954691513984 ext(0->8) 00002000:00010000:3.0:1789050040.768635:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c19ed80 00000100:00100000:1.0:1789050040.772602:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.772675:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691514112 00000100:00100000:2.0:1789050040.772684:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691514112 00000100:00100000:2.0:1789050040.772740:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:2.0:1789050040.772750:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+60:10433:x1875954691514112:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789050040.804032:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1789050040.804042:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789050040.804083:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789050040.804111:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789050040.804129:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789050040.804140:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff950704ed1cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789050040.804144:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073790f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950704ed19c0 00000020:00080000:0.0:1789050040.804148:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073790f500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9507052b9c00 00000020:00080000:0.0:1789050040.804194:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789050040.804343:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789050040.804785:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050040.804802:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704117376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789050040.804856:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050040.805126:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:10433:x1875954691514112:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 32375us (32530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050040.805135:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:2.0:1789050040.805652:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117376 00000100:00100000:2.0:1789050040.805666:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117376 00000100:00100000:2.0:1789050040.805728:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050040.805738:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704117376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050040.805742:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704117504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050040.805773:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050040.805802:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704117504 00000100:00100000:0.0:1789050040.805805:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704117504 00000100:00100000:0.0:1789050040.805830:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050040.805835:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704117504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789050040.805848:0:6670:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789050040.805858:0:6671:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789050040.805860:0:6671:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789050041531079465 00002000:00010000:2.0:1789050040.805862:0:6671:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789050040.805864:0:6671:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789050041373000000 -> 1789050041531079465 00002000:00010000:2.0:1789050040.805866:0:6671:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1789050040.805871:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x18d3fb881323685c, atime: 0x18d3fb8820220ff7, ctime: 0x18d3fb881323685c, blocks: 0x1 00010000:00010000:0.0:1789050040.805878:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.805899:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704117376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (1043us total) trans 4294967303 rc 0/0 00010000:00010000:0.0:1789050040.805903:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=276s v=(0 0) 00000100:00100000:2.0:1789050040.805904:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789050040.805907:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050040.805913:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.805929:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.805939:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.805947:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.805962:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050040.806395:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704117504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 558us (620us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789050040.806401:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789050040.806422:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050040.806427:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.806435:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050040.806439:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.806458:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.806474:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.806481:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b79008 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.806495:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050040.806498:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050040.806499:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050040.806873:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050040.806877:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789050040.807032:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c19e300/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789050040.807039:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704117504:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789050040.807052:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff950736c96a00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789050040.807056:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704117376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050040.816629:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.818360:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691514240 00000100:00100000:1.0:1789050040.818371:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691514240 00000100:00100000:1.0:1789050040.818418:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:1.0:1789050040.818428:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691514240:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789050040.854177:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1789050040.854193:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1789050040.854376:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691514240:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 35943us (37747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.854388:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:1.0:1789050040.857017:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.857112:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691514496 00000100:00100000:3.0:1789050040.857122:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691514496 00000100:00100000:3.0:1789050040.857315:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:3.0:1789050040.857405:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+13:10433:x1875954691514496:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050040.857451:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050040.857474:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b78ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8d4 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.857555:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:3.0:1789050040.857560:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050040.857588:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.857600:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.857611:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050040.857950:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000030deb91c reply state 00000000d5614dac transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050040.857971:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050040.858097:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+14:10433:x1875954691514496:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 771us (1086us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789050040.858105:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 81 00010000:00010000:1.0:1789050040.859764:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859777:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859784:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859790:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050040.859794:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859816:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859830:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:1.0:1789050040.859833:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050040.859838:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.859843:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7900f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.860886:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050040.860962:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691514624 00000100:00100000:0.0:1789050040.860978:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691514624 00000100:00100000:0.0:1789050040.861027:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:0.0:1789050040.861036:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691514624:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789050040.861354:0:8215:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789050040.861358:0:8215:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789050041531079465 -> 1789050040352000000 00002000:00010000:0.0:1789050040.861361:0:8215:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789050039069000000 00002000:00010000:0.0:1789050040.861363:0:8215:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789050041531079465 -> 1789050040352000000 00002000:00010000:0.0:1789050040.861365:0:8215:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789050040.861457:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691514624:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 422us (575us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789050040.861465:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:3.0:1789050040.870426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.870545:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691514880 00000100:00100000:2.0:1789050040.870556:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691514880 00000100:00100000:2.0:1789050040.870624:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:2.0:1789050040.870634:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:10433:x1875954691514880:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789050040.870706:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.870741:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.870750:0:5817:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.870781:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.870793:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 13 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.870805:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704117632:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050040.871005:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050040.876542:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704117632:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050040.876583:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:2.0:1789050040.876652:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.876688:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515008 00000100:00100000:1.0:1789050040.876705:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515008 00010000:00010000:1.0:1789050040.876739:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.876814:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:1.0:1789050040.876824:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+14:2347:x1875954691515008:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050040.876838:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050040.876845:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876858:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876877:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b78fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8c6 expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876904:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:1.0:1789050040.876909:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876918:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876926:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.876953:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050040.877015:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:2347:x1875954691515008:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 193us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050040.877022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00010000:00010000:2.0:1789050040.877315:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877322:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877348:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877357:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877370:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877376:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050040.877381:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877388:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877396:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:2.0:1789050040.877399:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789050040.877402:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.877408:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79016 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.877457:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+12:10433:x1875954691514880:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 Request processed in 6824us (7042us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789050040.877464:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:3.0:1789050040.896668:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050040.898430:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515136 00000100:00100000:0.0:1789050040.898443:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515136 00000100:00100000:0.0:1789050040.898512:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:0.0:1789050040.898522:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691515136:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789050040.898564:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.898582:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.898590:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050040.898594:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050040.898599:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.898632:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.898647:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 7 pid: 8215 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.898661:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c631f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1875954704117760:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050040.898753:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050040.906575:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c631f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1875954704117760:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050040.906607:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050040.910611:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.910771:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515264 00000100:00100000:2.0:1789050040.910781:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515264 00010000:00010000:2.0:1789050040.910818:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.910865:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:2.0:1789050040.910874:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691515264:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050040.910889:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050040.910908:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.910921:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.910943:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b79001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e2 expref: 8 pid: 8215 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.910972:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050040.910977:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050040.910982:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.910991:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.911028:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050040.911077:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691515264:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 203us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050040.911083:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00010000:00010000:0.0:1789050040.911868:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911880:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911911:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911919:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911927:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911934:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050040.911938:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911947:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911959:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.911967:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b7901d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.912037:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691515136:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 13515us (15376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050040.912045:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:3.0:1789050040.917768:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050040.917882:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515520 00000100:00100000:2.0:1789050040.917892:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515520 00000100:00100000:2.0:1789050040.917951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 83 00000100:00100000:2.0:1789050040.917960:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+12:10433:x1875954691515520:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050040.918028:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918044:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918055:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918330:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918342:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918351:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918381:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050040.918393:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 13 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050040.918404:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704117888:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050040.918487:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050040.923266:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.923367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515648 00000100:00100000:1.0:1789050040.923377:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515648 00010000:00010000:1.0:1789050040.923415:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.923457:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:1.0:1789050040.923468:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+14:2348:x1875954691515648:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050040.923481:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050040.923488:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.923503:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 14 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.923538:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:1.0:1789050040.923543:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.923551:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.923557:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.923573:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050040.923622:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+14:2348:x1875954691515648:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 157us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050040.923629:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00010000:00010000:0.0:1789050040.923892:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b78fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8cd expref: 13 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.923908:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704117888:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050040.923934:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.923942:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.923947:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050040.924117:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789050040.924320:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789050040.924363:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789050040.924466:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c631880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5818:1875954704118016:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789050040.924509:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050040.924601:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050040.924797:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118016 00000100:00100000:1.0:1789050040.924803:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118016 00000100:00100000:1.0:1789050040.924842:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050040.924849:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875954704118016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789050040.924912:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875954704118016:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050040.924918:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050040.925535:0:5818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789050040.925541:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff950736c96a00, transno 4294967303 00000100:00100000:0.0:1789050040.925550:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c631880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5818:1875954704118016:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789050040.926001:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789050040.926066:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c631880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5818:1875954704118144:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789050040.926121:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050040.926150:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050040.926302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118144 00000100:00100000:2.0:1789050040.926308:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118144 00000100:00100000:2.0:1789050040.926353:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050040.926367:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875954704118144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789050040.927323:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1875954704118144:12345-0@lo:1000:mdt00_001.0 Request processed in 954us (1198us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789050040.927332:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050040.927866:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c631880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5818:1875954704118144:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789050040.927904:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927924:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927932:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927937:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050040.927942:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927949:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927963:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dc800) 00010000:00010000:0.0:1789050040.927966:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050040.927971:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.927977:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7902b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928011:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928016:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928022:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928027:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050040.928035:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928042:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928049:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:0.0:1789050040.928051:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050040.928054:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928060:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bd24400/0x9df728c939b78f59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928080:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928094:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928114:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928145:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.928171:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 16 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.928184:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c633100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704118272:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050040.928280:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050040.932567:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050040.932649:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691515776 00000100:00100000:1.0:1789050040.932658:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691515776 00000100:00100000:0.0:1789050040.932688:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c633100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704118272:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050040.932716:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 17 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932726:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.932757:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:1.0:1789050040.932768:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+17:2348:x1875954691515776:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050040.932793:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050040.932801:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 17 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932814:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 17 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932835:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b78f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8b1 expref: 17 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932850:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:1.0:1789050040.932855:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932865:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932874:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050040.932901:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050040.932919:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932927:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932939:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932946:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932953:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932962:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc22364f0) 00000100:00100000:1.0:1789050040.932963:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+16:2348:x1875954691515776:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 193us (402us total) trans 0 rc 0/0 00010000:00010000:0.0:1789050040.932968:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050040.932975:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00010000:00010000:0.0:1789050040.932981:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.932993:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:0.0:1789050040.932997:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050040.933000:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933006:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79032 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933026:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933032:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933038:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933044:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050040.933047:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933053:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933061:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc500) 00010000:00010000:0.0:1789050040.933064:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050040.933067:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.933073:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050040.934793:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:10433:x1875954691515520:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 16827us (17026us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789050040.934804:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 83 00000020:00080000:0.0:1789050040.934809:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789050040.935137:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050040.935141:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050040.935168:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789050040.935176:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050040.939246:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050040.939315:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691516032 00000100:00100000:3.0:1789050040.939325:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691516032 00000100:00100000:3.0:1789050040.939372:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:3.0:1789050040.939382:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:10433:x1875954691516032:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789050040.940004:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789050040.940431:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789050040.940485:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940501:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940512:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940533:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940540:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940546:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050040.940682:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789050040.940816:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+17:10433:x1875954691516032:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 1433us (1577us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789050040.940826:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000020:00080000:3.0:1789050040.940832:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789050040.940883:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050040.940890:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.940904:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050040.940907:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.940915:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.940929:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9507114dcb00) 00010000:00010000:0.0:1789050040.940932:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789050040.940936:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.940941:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050040.940957:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050040.940959:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050040.940960:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050041.483430:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050041.996948:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050041.996988:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704118400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050041.997144:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050041.997405:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704118400 00000100:00100000:3.0:1789050041.997417:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704118400 00000100:00100000:3.0:1789050041.997483:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050041.997494:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704118400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050041.997530:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789050041.997596:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704118400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050041.997604:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050041.997840:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704118400:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789050042.453079:0:12038:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050042.453087:0:12038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050042.453122:0:12038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789050042.453128:0:12038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789050042.509550:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050042.551467:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.551550:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691516288 00000100:00100000:0.0:1789050042.551561:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691516288 00000100:00100000:0.0:1789050042.551627:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:0.0:1789050042.551638:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+17:10451:x1875954691516288:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050042.551662:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050042.551681:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8e9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.551791:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79047 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.551806:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.551819:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050042.551831:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789050042.551941:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e9 expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.551959:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e9 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.551968:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050042.551972:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050042.551975:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:0.0:1789050042.552026:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:10451:x1875954691516288:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 390us (568us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789050042.552034:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00080000:3.0:1789050042.552531:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050042.558830:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050042.558892:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691516416 00000100:00100000:3.0:1789050042.558901:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691516416 00000100:00100000:3.0:1789050042.558962:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:3.0:1789050042.558971:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+19:10451:x1875954691516416:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050042.559047:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559062:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559074:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559089:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559096:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559103:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559348:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559358:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559365:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050042.559400:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559411:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559424:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559431:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559436:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.559440:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559447:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559459:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050042.559462:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.559467:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559473:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559485:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559491:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559497:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559502:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.559510:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559517:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559525:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9507114dcc00) 00010000:00010000:3.0:1789050042.559527:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.559530:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559536:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7905c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559549:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559555:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559561:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559566:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.559569:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559574:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559581:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9507114dc100) 00010000:00010000:3.0:1789050042.559584:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.559592:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.559599:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050042.559666:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+19:10451:x1875954691516416:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 695us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050042.559674:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:0.0:1789050042.608790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.608822:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691516672 00000100:00100000:0.0:1789050042.608831:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691516672 00000100:00100000:0.0:1789050042.608873:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:0.0:1789050042.608882:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:10454:x1875954691516672:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050042.608919:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050042.608938:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7906a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8f0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609780:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609797:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609808:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609821:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609828:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.609835:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610423:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610434:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610443:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050042.610452:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789050042.610543:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610551:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610558:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610563:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050042.610567:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610574:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610584:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050042.610587:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050042.610592:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610597:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79071 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610606:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610612:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610618:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610622:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050042.610631:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610637:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610645:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950714b52900) 00010000:00010000:0.0:1789050042.610647:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050042.610650:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.610656:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.611193:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7906a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.611231:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.611239:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050042.611241:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050042.611244:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:0.0:1789050042.611306:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:10454:x1875954691516672:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2424us (2522us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789050042.611315:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:2.0:1789050042.614564:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.614607:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691516800 00000100:00100000:2.0:1789050042.614617:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691516800 00000100:00100000:2.0:1789050042.614665:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:2.0:1789050042.614676:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+21:10454:x1875954691516800:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050042.614747:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614762:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614773:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614797:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614803:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614816:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614822:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050042.614826:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614834:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614845:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050042.614849:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050042.614853:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.614860:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7908d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050042.614920:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+21:10454:x1875954691516800:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 246us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050042.614927:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:2.0:1789050042.617395:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050042.617471:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517056 00000100:00100000:3.0:1789050042.617480:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517056 00000100:00100000:3.0:1789050042.617550:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050042.617560:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:10454:x1875954691517056:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050042.617758:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+22:10454:x1875954691517056:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 199us (369us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789050042.617765:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:2.0:1789050042.656909:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.656987:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517312 00000100:00100000:0.0:1789050042.656997:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517312 00000100:00100000:0.0:1789050042.657061:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:0.0:1789050042.657071:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+22:9976:x1875954691517312:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:0.0:1789050042.657107:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050042.657131:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79094 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8f7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.657262:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.657277:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.657285:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.657315:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.657327:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 23 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050042.657340:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c633800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704118528:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050042.657476:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050042.664360:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.664496:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c633800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704118528:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050042.664523:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050042.667870:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517440 00000100:00100000:1.0:1789050042.667884:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517440 00010000:00010000:1.0:1789050042.668193:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 24 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050042.668320:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789050042.668331:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+24:2348:x1875954691517440:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050042.668344:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050042.668352:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 24 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668364:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 24 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668384:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7907f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f0 expref: 24 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668403:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:1.0:1789050042.668408:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668417:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668424:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.668454:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050042.668521:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+23:2348:x1875954691517440:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 192us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050042.668529:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00010000:00010000:0.0:1789050042.669435:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.669446:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050042.669475:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789050042.669610:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.669628:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.669636:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050042.669640:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050042.669643:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330a00, rc 0) 00000100:00100000:0.0:1789050042.669699:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+23:9976:x1875954691517312:12345-192.168.206.1@tcp:101:bash.0 Request processed in 12629us (12797us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789050042.669707:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:2.0:1789050042.672851:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050042.672935:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517696 00000100:00100000:3.0:1789050042.672945:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517696 00000100:00100000:3.0:1789050042.673005:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:3.0:1789050042.673015:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+23:9976:x1875954691517696:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:3.0:1789050042.673452:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.673468:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.673479:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050042.673530:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789050042.673576:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000db67ce61 reply state 00000000b3ab51ae transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050042.673585:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789050042.673732:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789050042.673874:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+27:9976:x1875954691517696:12345-192.168.206.1@tcp:36:bash.0 Request processed in 858us (1029us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789050042.673881:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 89 00000020:00080000:3.0:1789050042.673886:0:8158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789050042.677438:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:1.0:1789050042.677486:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.677499:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.677507:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.677513:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050042.677518:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050042.677525:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517824 00010000:00010000:1.0:1789050042.677526:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050042.677536:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517824 00010000:00010000:1.0:1789050042.677543:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:1.0:1789050042.677548:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050042.677553:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.677559:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b790a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050042.677590:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:2.0:1789050042.677611:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:9976:x1875954691517824:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050042.677650:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050042.677666:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b790b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f8fe expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.677724:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b790b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8fe expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.677736:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b790b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8fe expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.677752:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050042.677755:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050042.677757:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050042.677808:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:9976:x1875954691517824:12345-192.168.206.1@tcp:101:bash.0 Request processed in 200us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050042.677815:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:0.0:1789050042.681192:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.681639:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691517952 00000100:00100000:2.0:1789050042.681650:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691517952 00000100:00100000:2.0:1789050042.681724:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:2.0:1789050042.681736:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:9976:x1875954691517952:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050042.681753:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050042.681775:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f905 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050042.681799:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb886c944800, atime: 0x18d3fb88201b4140, ctime: 0x18d3fb886c944800, blocks: 0xb 00010000:00010000:2.0:1789050042.681827:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1789050042.681844:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050042.681852:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.681870:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.681882:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51e00, rc 0) 00000100:00100000:2.0:1789050042.681940:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:9976:x1875954691517952:12345-192.168.206.1@tcp:101:bash.0 Request processed in 207us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050042.681946:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00080000:3.0:1789050042.682630:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050042.684800:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.684941:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518080 00000100:00100000:0.0:1789050042.684950:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518080 00002000:00010000:0.0:1789050042.685068:0:6676:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789050042.685073:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073f424700 with x1875954691518080 ext(0->18446744073709551615) 00002000:00010000:0.0:1789050042.685084:0:6676:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073f424700. 00000100:00100000:0.0:1789050042.685116:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:0.0:1789050042.685126:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691518080:12345-192.168.206.1@tcp:10:bash.0 00002000:00010000:0.0:1789050042.685430:0:6676:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789050042.685434:0:6676:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789050040352000000 -> 1789050043440000000 00002000:00010000:0.0:1789050042.685436:0:6676:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789050039069000000 -> 1789050039069000000 00002000:00010000:0.0:1789050042.685451:0:6676:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789050040352000000 -> 1789050043440000000 00002000:00010000:0.0:1789050042.685453:0:6676:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789050042.685503:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691518080:12345-192.168.206.1@tcp:10:bash.0 Request processed in 379us (711us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789050042.685511:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00002000:00010000:0.0:1789050042.685514:0:6676:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789050042.685517:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073f424700 with x1875954691518080 ext(0->18446744073709551615) 00002000:00010000:0.0:1789050042.685521:0:6676:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073f424700. 00000100:00100000:0.0:1789050042.751671:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050042.751754:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518208 00000100:00100000:3.0:1789050042.751763:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518208 00000100:00100000:3.0:1789050042.751822:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 91 00000100:00100000:3.0:1789050042.751832:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+27:10468:x1875954691518208:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050042.751897:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.751914:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.751925:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.751940:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.751947:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.751954:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752170:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752179:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752187:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050042.752258:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752280:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752286:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752292:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752299:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.752303:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752310:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752320:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050042.752323:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.752327:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752339:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b790be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752352:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752358:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752363:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752368:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.752371:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752376:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752383:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9507114dc100) 00010000:00010000:3.0:1789050042.752386:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.752389:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752394:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b790c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752408:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752413:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752426:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752430:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.752434:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752439:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752447:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050042.752450:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050042.752452:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.752457:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b790cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050042.752525:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+27:10468:x1875954691518208:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 694us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050042.752532:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 91 00000100:00100000:3.0:1789050042.791050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.791225:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518464 00000100:00100000:2.0:1789050042.791234:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518464 00000100:00100000:2.0:1789050042.791336:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:2.0:1789050042.791346:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:10471:x1875954691518464:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050042.791364:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050042.791382:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b790d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f90c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791445:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791460:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791471:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791483:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791501:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791508:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791751:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b790e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791760:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b790e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791768:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b790e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050042.791777:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789050042.791850:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791858:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791864:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791870:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050042.791874:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791880:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791900:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050042.791904:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050042.791908:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791915:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b790da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791926:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791932:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791938:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791943:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050042.791945:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791950:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791957:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1700) 00010000:00010000:2.0:1789050042.791959:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050042.791961:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.791966:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b790e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.792008:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b790d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f90c expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.792020:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b790e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f90c expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.792028:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050042.792030:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789050042.792032:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50600, rc 0) 00000100:00100000:2.0:1789050042.792090:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+29:10471:x1875954691518464:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 745us (1048us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789050042.792097:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:3.0:1789050042.800107:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.800182:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518592 00000100:00100000:2.0:1789050042.800191:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518592 00000100:00100000:2.0:1789050042.803064:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:2.0:1789050042.803086:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+29:10471:x1875954691518592:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050042.803254:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.803272:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.803281:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.803315:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.803347:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 29 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050042.803361:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704118656:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050042.803673:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050042.807600:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704118656:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050042.807631:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050042.813173:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.813352:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518848 00000100:00100000:2.0:1789050042.813362:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518848 00000100:00100000:2.0:1789050042.813417:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:2.0:1789050042.813429:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+30:5589:x1875954691518848:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000001:00080000:2.0:1789050042.813668:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:2.0:1789050042.813791:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+32:5589:x1875954691518848:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 363us (624us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789050042.813798:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000020:00080000:2.0:1789050042.813803:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050042.816396:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.816536:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691518976 00000100:00100000:0.0:1789050042.816546:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691518976 00010000:00010000:0.0:1789050042.816582:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 32 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050042.816623:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:0.0:1789050042.816632:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+32:2347:x1875954691518976:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050042.816647:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050042.816653:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 32 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816666:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 32 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816702:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7909b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8f7 expref: 32 pid: 5819 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816719:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050042.816736:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816746:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816753:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.816993:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050042.817048:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+31:2347:x1875954691518976:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 416us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050042.817057:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00010000:00010000:3.0:1789050042.818052:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818065:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818109:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818117:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818123:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818129:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050042.818133:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818140:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818154:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050042.818157:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050042.818160:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050042.818166:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b790f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050042.818542:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+30:10471:x1875954691518592:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 15464us (18440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050042.818552:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:3.0:1789050042.820713:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.820836:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691519232 00000100:00100000:2.0:1789050042.820846:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691519232 00000100:00100000:2.0:1789050042.820969:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050042.820981:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+30:10471:x1875954691519232:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050042.821194:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+31:10471:x1875954691519232:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 216us (488us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789050042.821239:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:0.0:1789050042.917341:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050042.917498:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691519488 00000100:00100000:2.0:1789050042.917508:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691519488 00000100:00100000:2.0:1789050042.917563:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:2.0:1789050042.917572:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+31:10482:x1875954691519488:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:2.0:1789050042.917593:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050042.917610:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b790fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f913 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917675:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917697:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917710:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917722:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917729:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.917735:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918045:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918055:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918073:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050042.918083:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789050042.918163:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918170:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918177:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918183:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050042.918187:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918194:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918238:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050042.918241:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050042.918246:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918252:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918274:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918280:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918293:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918298:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050042.918300:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918306:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918314:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1700) 00010000:00010000:2.0:1789050042.918317:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050042.918320:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918326:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7910b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918367:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b790fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f913 expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918380:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f913 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.918387:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050042.918389:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050042.918392:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050042.918623:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+33:10482:x1875954691519488:12345-192.168.206.1@tcp:101:cat.0 Request processed in 1051us (1288us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789050042.918638:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:1.0:1789050042.932545:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050042.932841:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691519744 00000100:00100000:3.0:1789050042.932851:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691519744 00000100:00100000:3.0:1789050042.932977:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:3.0:1789050042.932988:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+33:10482:x1875954691519744:12345-192.168.206.1@tcp:35:cat.0 00000100:00100000:3.0:1789050042.933265:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+34:10482:x1875954691519744:12345-192.168.206.1@tcp:35:cat.0 Request processed in 278us (728us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789050042.933273:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:3.0:1789050042.965944:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050042.966592:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520000 00000100:00100000:0.0:1789050042.966602:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520000 00000100:00100000:0.0:1789050042.966657:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:0.0:1789050042.966667:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+34:10483:x1875954691520000:12345-192.168.206.1@tcp:36:rm.0 00010000:00010000:0.0:1789050042.966729:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789050042.966753:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f913 expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966773:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b790e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f90c expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966795:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b790b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8fe expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966805:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050042.966826:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050042.966844:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966865:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966875:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966888:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966895:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.966900:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.967120:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.967128:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.967135:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050042.968363:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1789050042.968374:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 278956173612ns, next at 279956171468ns, rc = 0 00010000:00010000:0.0:1789050042.968443:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.968466:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.968476:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.968485:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.968492:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.968570:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972042:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050042.972080:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972092:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972099:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972105:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050042.972109:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972116:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972152:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52d00) 00010000:00010000:0.0:1789050042.972157:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789050042.972162:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972168:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7912e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972191:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972213:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972219:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972224:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050042.972227:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972233:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972241:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050042.972243:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050042.972246:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050042.972253:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79120 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050042.972273:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000094d79e54 reply state 000000005693056d transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050042.972282:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050042.972425:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+33:10483:x1875954691520000:12345-192.168.206.1@tcp:36:rm.0 Request processed in 5754us (6483us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789050042.972434:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 95 00010000:00010000:2.0:1789050042.973021:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050042.973029:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.973036:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050042.973040:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.973047:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.973058:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff950714b52d00) 00010000:00010000:2.0:1789050042.973060:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789050042.973063:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.973069:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79135 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050042.973090:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050042.973091:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050042.973093:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050042.980622:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980638:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980646:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980671:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050042.980675:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980691:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980707:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950714b52900) 00010000:00010000:1.0:1789050042.980710:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050042.980715:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050042.980721:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b79127 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050043.019450:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050043.019459:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050043.019493:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789050043.019499:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050043.034518:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.034616:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520256 00000100:00100000:2.0:1789050043.034836:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520256 00000100:00100000:2.0:1789050043.034909:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:2.0:1789050043.034919:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+32:10489:x1875954691520256:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050043.034940:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.034958:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7913c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f91a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035077:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035091:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035103:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035115:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035121:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035128:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789050043.035644:0:5819:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789050043.035803:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035812:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035819:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035845:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035861:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035867:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035872:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.035876:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035882:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035892:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050043.035895:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.035899:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035904:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79143 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050043.035916:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000caf8c96a reply state 00000000122c385b transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.035924:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050043.035949:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7913c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035962:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.035980:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050043.035982:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050043.035985:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050043.036060:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+35:10489:x1875954691520256:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1142us (1553us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789050043.036068:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:0.0:1789050043.041825:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.043638:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520384 00000100:00100000:2.0:1789050043.043659:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520384 00000100:00100000:2.0:1789050043.043755:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:2.0:1789050043.043773:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691520384:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050043.043794:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.043826:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f921 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050043.043860:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050043.043884:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=279s v=(0 0) 00010000:00010000:2.0:1789050043.043889:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050043.043900:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.043924:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.043940:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50600, rc 0) 00000100:00100000:2.0:1789050043.044014:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691520384:12345-192.168.206.1@tcp:101:bash.0 Request processed in 248us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.044038:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00080000:3.0:1789050043.044404:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789050043.045587:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045604:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045611:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045618:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050043.045623:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045631:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045670:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1700) 00010000:00010000:1.0:1789050043.045673:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050043.045680:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.045696:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7914a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.049097:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.049235:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520512 00000100:00100000:3.0:1789050043.049247:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520512 00000100:00100000:3.0:1789050043.049308:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:3.0:1789050043.049318:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+8:10489:x1875954691520512:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050043.049339:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050043.049359:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f928 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.049396:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.049412:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050043.049417:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050043.049425:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 9 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.049465:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.049506:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.049521:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875954704118784:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050043.049642:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050043.053057:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875954704118784:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050043.053103:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 9 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.053127:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06400, rc 0) 00000100:00100000:0.0:1789050043.053239:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+9:10489:x1875954691520512:12345-192.168.206.1@tcp:101:bash.0 Request processed in 3881us (4115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.053250:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:0.0:1789050043.055194:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050043.055261:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520640 00000100:00100000:1.0:1789050043.055273:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520640 00010000:00010000:1.0:1789050043.055321:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.055369:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:1.0:1789050043.055381:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691520640:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050043.055400:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050043.055425:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.055441:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.055467:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7915f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f921 expref: 9 pid: 6671 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.055508:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050043.055512:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050043.055522:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.055533:0:5803:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.055583:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.055598:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5803:1875954704118912:192.168.206.1@tcp:105: 00000100:00100000:1.0:1789050043.055709:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050043.059003:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.059121:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5803:1875954704118912:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050043.059149:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050043.059233:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691520640:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 3852us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.059246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:0.0:1789050043.059426:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691520896 00000100:00100000:0.0:1789050043.059436:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691520896 00000100:00100000:0.0:1789050043.059490:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:0.0:1789050043.059501:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+34:10489:x1875954691520896:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:0.0:1789050043.059872:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000100:00100000:0.0:1789050043.062154:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:10489:x1875954691520896:12345-192.168.206.1@tcp:35:bash.0 Request processed in 2640us (3148us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789050043.062171:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 25 00000020:00080000:0.0:1789050043.062181:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050043.089696:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050043.089754:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.089854:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521152 00000100:00100000:2.0:1789050043.089867:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521152 00000100:00100000:2.0:1789050043.089980:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:2.0:1789050043.089994:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691521152:12345-192.168.206.1@tcp:16:kworker.0 00000100:00100000:2.0:1789050043.090151:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691521152:12345-192.168.206.1@tcp:16:kworker.0 Request processed in 160us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.090159:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050043.090264:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521024 00000100:00100000:3.0:1789050043.090269:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521024 00002000:00100000:3.0:1789050043.090301:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff950736c96a00 x1875954691521024/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:544/0 lens 504/0 e 0 to 0 dl 1789050054 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050043.090311:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950736c96a00 with x1875954691521024 ext(0->8) 00002000:00010000:3.0:1789050043.090317:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff950736c96a00 00000100:00100000:3.0:1789050043.090341:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:3.0:1789050043.090349:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691521024:12345-192.168.206.1@tcp:4:bash.0 00000100:00100000:3.0:1789050043.091145:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691521024:12345-192.168.206.1@tcp:4:bash.0 Request processed in 791us (1384us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789050043.091155:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00002000:00100000:3.0:1789050043.091164:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff950736c96a00 x1875954691521024/t4294967302(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:544/0 lens 504/448 e 0 to 0 dl 1789050054 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050043.091186:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950736c96a00 with x1875954691521024 ext(0->8) 00002000:00010000:3.0:1789050043.091191:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff950736c96a00 00000100:00100000:1.0:1789050043.201861:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.202142:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521280 00000100:00100000:3.0:1789050043.202359:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521280 00000100:00100000:3.0:1789050043.202500:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:3.0:1789050043.202513:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+36:10505:x1875954691521280:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050043.202548:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050043.202621:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7916d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f92f expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.202746:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.202961:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.202978:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050043.203083:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789050043.203087:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050043.203119:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.203149:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7916d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f92f expref: 38 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.203183:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f92f expref: 37 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.203254:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050043.203257:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050043.203261:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07e00, rc 0) 00000100:00100000:3.0:1789050043.203443:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+37:10505:x1875954691521280:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 932us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.203453:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:1.0:1789050043.210993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.211150:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521536 00000100:00100000:2.0:1789050043.211163:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521536 00000100:00100000:2.0:1789050043.211279:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:2.0:1789050043.211796:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+37:10505:x1875954691521536:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050043.211821:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.211846:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7917b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f936 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.211961:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.211978:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.211991:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.212005:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789050043.212154:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7917b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f936 expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.212197:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f936 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.212249:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050043.212252:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050043.212257:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050043.213918:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+39:10505:x1875954691521536:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2118us (2930us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1789050043.213931:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:1.0:1789050043.221867:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050043.221918:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.222032:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521664 00000100:00100000:0.0:1789050043.222046:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521664 00000100:00100000:0.0:1789050043.222130:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:0.0:1789050043.222142:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+39:2349:x1875954691521664:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050043.222163:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050043.222192:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f936 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.222252:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050043.222269:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050043.222338:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+38:2349:x1875954691521664:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 198us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.222347:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789050043.223252:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691521920 00000100:00100000:2.0:1789050043.223262:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691521920 00000100:00100000:2.0:1789050043.223317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:2.0:1789050043.223327:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+38:10505:x1875954691521920:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050043.223455:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.223477:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f93d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.223589:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.223607:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.223620:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.223635:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789050043.224080:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f93d expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.224102:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f93d expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.224111:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050043.224115:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789050043.224118:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050043.224182:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+40:10505:x1875954691521920:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 857us (2263us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789050043.224190:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:0.0:1789050043.233110:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050043.233236:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522048 00000100:00100000:1.0:1789050043.233248:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522048 00000100:00100000:1.0:1789050043.233309:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:1.0:1789050043.233320:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+10:2348:x1875954691522048:12345-192.168.206.1@tcp:1:lfs.0 00010000:00010000:1.0:1789050043.233374:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.233415:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 10 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.233425:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050043.233431:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050043.233436:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.233479:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 10 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.233495:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 10 pid: 8215 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.233511:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704119040:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050043.233625:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050043.238491:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.238619:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704119040:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050043.238654:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.239611:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522176 00000100:00100000:3.0:1789050043.239709:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522176 00010000:00010000:3.0:1789050043.239756:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 11 pid: 8215 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.239796:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:3.0:1789050043.239807:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+11:2347:x1875954691522176:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050043.239822:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789050043.239841:0:5803:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789050043.239844:0:5803:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789050043826821621 00002000:00010000:3.0:1789050043.239847:0:5803:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789050043826821621 00010000:00010000:3.0:1789050043.239855:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 11 pid: 8215 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.239869:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 11 pid: 8215 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.239890:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ef35774/0x9df728c939b79166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f928 expref: 11 pid: 8215 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.239924:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050043.239928:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050043.239933:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.239941:0:5803:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.239972:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050043.240016:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240032:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240072:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240080:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240110:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240117:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050043.240123:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240134:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240152:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.240159:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e7f8a0/0x9df728c939b791a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.240287:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691522176:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 479us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.240297:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:2.0:1789050043.240471:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691522048:12345-192.168.206.1@tcp:1:lfs.0 Request processed in 7148us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.240481:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:1.0:1789050043.243232:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.243482:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522432 00000100:00100000:0.0:1789050043.243498:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522432 00000100:00100000:0.0:1789050043.243583:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:0.0:1789050043.243595:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+40:10505:x1875954691522432:12345-192.168.206.1@tcp:35:lfs.0 00000004:00010000:0.0:1789050043.243679:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f93d expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050043.243997:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1789050043.244040:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789050043.244439:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789050043.244497:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.244516:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.244527:0:5820:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.244588:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.244605:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 44 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050043.244622:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875954704119168:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050043.244742:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050043.248729:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875954704119168:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050043.248773:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.249471:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.250457:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522560 00000100:00100000:3.0:1789050043.250467:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522560 00010000:00010000:3.0:1789050043.250505:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 45 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.250609:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789050043.250620:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+45:2347:x1875954691522560:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050043.250634:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050043.250641:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 45 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250653:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 45 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250704:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f91a expref: 45 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250720:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050043.250726:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250734:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250742:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.250773:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050043.250832:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+44:2347:x1875954691522560:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 212us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.250840:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00010000:00010000:2.0:1789050043.250840:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.250857:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050043.251035:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000001:00080000:2.0:1789050043.251327:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:2.0:1789050043.251451:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704119296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050043.251532:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050043.251607:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119296 00000100:00100000:2.0:1789050043.251614:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119296 00000100:00100000:2.0:1789050043.251668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050043.251677:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1875954704119296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050043.251758:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1875954704119296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.251765:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789050043.251787:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050043.251801:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050043.251828:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704119296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789050043.252345:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00000100:00100000:2.0:1789050043.252403:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704119424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789050043.252432:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050043.252464:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050043.252763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119424 00000100:00100000:1.0:1789050043.252769:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119424 00000100:00100000:1.0:1789050043.252809:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050043.252818:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1875954704119424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789050043.253010:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5820:x1875954704119424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 193us (576us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789050043.253029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050043.253119:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875954704119424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789050043.253470:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:0.0:1789050043.253535:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253546:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253569:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253574:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050043.253579:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253587:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253665:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050043.253669:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789050043.253674:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.253690:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050043.253882:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789050043.253973:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1789050043.254053:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279241852820ns, next at 280241850251ns, rc = 0 00000001:00080000:0.0:1789050043.254061:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00010000:00010000:0.0:1789050043.254099:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050043.254102:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789050043.254109:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f93d expref: 48 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050043.254384:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+47:10505:x1875954691522432:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 10790us (11189us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789050043.254407:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000020:00080000:0.0:1789050043.254413:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789050043.257173:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.257364:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522688 00000100:00100000:0.0:1789050043.257376:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522688 00000100:00100000:0.0:1789050043.257434:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:0.0:1789050043.257445:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+47:10505:x1875954691522688:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050043.257478:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050043.257505:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b791b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f944 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.258163:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b791b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f944 expref: 48 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.258184:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b791b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f944 expref: 48 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.258980:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050043.258987:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050043.258992:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:0.0:1789050043.259078:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+48:10505:x1875954691522688:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1632us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.259087:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:3.0:1789050043.269042:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.269239:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691522944 00000100:00100000:2.0:1789050043.269252:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691522944 00000100:00100000:2.0:1789050043.269328:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050043.269339:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+48:10505:x1875954691522944:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050043.269626:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+49:10505:x1875954691522944:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 288us (597us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789050043.269634:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:1.0:1789050043.348726:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.348916:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691523072 00000100:00100000:2.0:1789050043.348926:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691523072 00000100:00100000:2.0:1789050043.349044:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:2.0:1789050043.349067:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+49:10515:x1875954691523072:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:2.0:1789050043.349152:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349170:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349183:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349239:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349248:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349255:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349337:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349346:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349353:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050043.349392:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349405:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349418:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349425:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349432:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.349436:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349453:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349465:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050043.349468:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.349473:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349480:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349493:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349499:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349505:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349510:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.349518:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349524:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349532:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1000) 00010000:00010000:2.0:1789050043.349535:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.349537:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349543:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349557:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349563:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349568:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349574:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.349576:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349581:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349588:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050043.349590:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.349599:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.349605:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.349679:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+49:10515:x1875954691523072:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 613us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.349698:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:1.0:1789050043.379842:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.379935:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691523328 00000100:00100000:2.0:1789050043.379945:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691523328 00000100:00100000:2.0:1789050043.380001:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:2.0:1789050043.380010:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+49:10518:x1875954691523328:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050043.380028:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.380045:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f94b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380108:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380122:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380132:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380146:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380153:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380173:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380294:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380302:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380308:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.380316:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789050043.380400:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380408:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380415:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380421:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.380425:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380432:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380443:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050043.380446:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.380457:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380463:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b791d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380476:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380482:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380488:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380493:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.380496:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380503:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380510:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1000) 00010000:00010000:2.0:1789050043.380513:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.380516:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380522:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b791dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380558:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b791cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 52 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380583:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.380589:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050043.380592:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050043.380594:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050043.380764:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+51:10518:x1875954691523328:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 753us (928us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789050043.380772:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:1.0:1789050043.384788:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.386031:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691523456 00000100:00100000:0.0:1789050043.386043:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691523456 00000100:00100000:0.0:1789050043.386153:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 103 00000100:00100000:0.0:1789050043.386164:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+51:10518:x1875954691523456:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:0.0:1789050043.386257:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386285:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386297:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386321:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386328:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386335:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386341:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050043.386345:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386352:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386363:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050043.386367:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050043.386372:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.386379:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050043.386451:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+51:10518:x1875954691523456:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 289us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.386459:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 103 00000100:00100000:1.0:1789050043.388791:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.389188:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691523712 00000100:00100000:0.0:1789050043.389228:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691523712 00000100:00100000:0.0:1789050043.389388:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:0.0:1789050043.389398:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+51:10518:x1875954691523712:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050043.389654:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+52:10518:x1875954691523712:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 257us (869us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789050043.389661:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:1.0:1789050043.457898:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.457992:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691523968 00000100:00100000:0.0:1789050043.458002:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691523968 00000100:00100000:0.0:1789050043.458079:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 104 00000100:00100000:0.0:1789050043.458089:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+52:10528:x1875954691523968:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:0.0:1789050043.458114:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050043.458117:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050043.458141:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f92f expref: 52 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458160:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050043.458165:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050043.458190:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f952 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458738:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458766:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 52 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458775:0:5817:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458805:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 52 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.458818:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 52 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050043.458831:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704119552:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050043.458955:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050043.466154:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704119552:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050043.466195:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.467793:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.467870:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524096 00000100:00100000:3.0:1789050043.467879:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524096 00010000:00010000:3.0:1789050043.467914:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 53 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.467954:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:3.0:1789050043.467964:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+53:2348:x1875954691524096:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050043.467977:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050043.467984:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 53 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468010:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 53 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468031:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b791e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f94b expref: 53 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468046:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050043.468052:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468062:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468069:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.468100:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050043.468155:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+52:2348:x1875954691524096:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 192us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.468163:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00010000:00010000:2.0:1789050043.468656:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.468666:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.468698:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789050043.468835:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b791f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.468851:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.468859:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050043.468861:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789050043.468864:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330e00, rc 0) 00000100:00100000:2.0:1789050043.468906:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+52:10528:x1875954691523968:12345-192.168.206.1@tcp:101:bash.0 Request processed in 10818us (11016us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789050043.468924:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 104 00000100:00100000:1.0:1789050043.472937:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.473013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524352 00000100:00100000:2.0:1789050043.473023:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524352 00000100:00100000:2.0:1789050043.473081:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 105 00000100:00100000:2.0:1789050043.473091:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+52:10528:x1875954691524352:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:2.0:1789050043.473388:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.473403:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.473413:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050043.473465:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967397 00000004:00010000:2.0:1789050043.473495:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000085672d07 reply state 00000000258635ec transno 4294967398 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.473504:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050043.474020:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+55:10528:x1875954691524352:12345-192.168.206.1@tcp:36:bash.0 Request processed in 929us (1089us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789050043.474028:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 105 00000020:00080000:2.0:1789050043.474033:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050043.480127:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.480231:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524480 00000100:00100000:2.0:1789050043.480240:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524480 00000100:00100000:2.0:1789050043.480301:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 106 00000100:00100000:2.0:1789050043.480311:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+55:10528:x1875954691524480:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050043.480345:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.480376:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f959 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480465:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480480:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480488:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480495:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480510:0:5819:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480531:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.480543:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.480555:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704119680:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050043.480639:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e480 going to sleep for 11 seconds 00010000:00010000:3.0:1789050043.481246:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481264:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481272:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481291:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050043.481295:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481302:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481317:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050043.481330:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050043.481333:0:3268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481341:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.481348:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7920e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.484188:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704119680:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050043.484504:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.484866:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.485040:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524608 00000100:00100000:3.0:1789050043.485048:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524608 00010000:00010000:3.0:1789050043.485082:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050043.485155:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:3.0:1789050043.485163:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:2347:x1875954691524608:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050043.485175:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050043.485181:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485223:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485246:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79200 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f952 expref: 56 pid: 5817 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485261:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050043.485267:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485276:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485284:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.485312:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050043.485377:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+55:2347:x1875954691524608:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 213us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.485386:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00010000:00010000:2.0:1789050043.485440:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.485448:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.485492:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789050043.485496:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050043.485515:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.485545:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.485560:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.485567:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050043.485570:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050043.485572:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050043.485598:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:10528:x1875954691524480:12345-192.168.206.1@tcp:101:bash.0 Request processed in 5289us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.485605:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 106 00000100:00100000:1.0:1789050043.492583:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.492715:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524864 00000100:00100000:2.0:1789050043.492725:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524864 00000100:00100000:2.0:1789050043.492779:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:2.0:1789050043.492790:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+54:10528:x1875954691524864:12345-192.168.206.1@tcp:35:bash.0 00000100:00100000:2.0:1789050043.493380:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+55:10528:x1875954691524864:12345-192.168.206.1@tcp:35:bash.0 Request processed in 590us (802us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789050043.493404:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 29 00010000:00010000:2.0:1789050043.532612:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050043.549817:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.549936:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691524992 00000100:00100000:3.0:1789050043.549946:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691524992 00000100:00100000:3.0:1789050043.550000:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 107 00000100:00100000:3.0:1789050043.550011:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+55:10534:x1875954691524992:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050043.550034:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050043.550053:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f960 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550140:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550155:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550166:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050043.550216:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789050043.550220:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050043.550238:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550283:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f960 expref: 57 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550300:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f960 expref: 56 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.550308:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050043.550311:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050043.550314:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07a00, rc 0) 00000100:00100000:3.0:1789050043.550363:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691524992:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 354us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.550369:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 107 00000100:00100000:3.0:1789050043.552775:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.552803:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691525120 00000100:00100000:2.0:1789050043.552811:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691525120 00000100:00100000:2.0:1789050043.552864:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 108 00000100:00100000:2.0:1789050043.552875:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691525120:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050043.552891:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.552908:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79231 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f967 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553394:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553409:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553421:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553435:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553442:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553448:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553701:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553722:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553729:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050043.553763:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789050043.553767:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050043.553784:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553794:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553802:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553809:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553815:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553821:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.553825:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553832:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553844:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050043.553847:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.553857:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553863:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553875:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553881:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553887:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553892:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050043.553895:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553900:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553907:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95072c9b1d00) 00010000:00010000:2.0:1789050043.553910:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050043.553912:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553918:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7923f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.553947:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f967 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.554413:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f967 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.554421:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050043.554424:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050043.554426:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050043.554492:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:10534:x1875954691525120:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1619us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050043.554501:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 108 00000100:00100000:1.0:1789050043.559059:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.559296:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691525248 00000100:00100000:0.0:1789050043.559306:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691525248 00000100:00100000:0.0:1789050043.559354:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050043.559363:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+57:2348:x1875954691525248:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050043.559376:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050043.559398:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f967 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.559438:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050043.559442:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050043.559487:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:2348:x1875954691525248:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 124us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.559495:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:1.0:1789050043.559705:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.559936:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691525504 00000100:00100000:2.0:1789050043.559941:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691525504 00000100:00100000:2.0:1789050043.559977:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 109 00000100:00100000:2.0:1789050043.559985:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691525504:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050043.559998:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050043.560012:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7924d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f96e expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.560099:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.560112:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.560119:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.560148:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050043.560169:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 57 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050043.560181:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704119808:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050043.560365:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050043.562892:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050043.563444:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704119808:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050043.563472:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.563800:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691525632 00000100:00100000:1.0:1789050043.563808:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691525632 00010000:00010000:1.0:1789050043.563837:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 58 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050043.563870:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050043.563879:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+58:2347:x1875954691525632:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050043.563892:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050043.563899:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 58 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.563910:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 58 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.563940:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b7921c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f959 expref: 58 pid: 5819 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.563954:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:1.0:1789050043.564478:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.564491:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.564499:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.564530:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050043.564580:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:2347:x1875954691525632:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 701us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050043.564588:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00010000:00010000:0.0:1789050043.565116:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.565125:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050043.565144:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789050043.565934:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7924d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 58 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.565957:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 57 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.565965:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050043.565969:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050043.565972:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:0.0:1789050043.566036:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+57:10534:x1875954691525504:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 6051us (6330us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789050043.566044:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 109 00000001:00080000:1.0:1789050043.568654:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1789050043.568672:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1789050043.568693:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789050043.568701:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789050043.569716:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050043.569878:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691525888 00000100:00100000:1.0:1789050043.569887:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691525888 00000100:00100000:1.0:1789050043.569982:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:1.0:1789050043.569993:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+57:10534:x1875954691525888:12345-192.168.206.1@tcp:103:lfs.0 00010000:00010000:1.0:1789050043.570006:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050043.570029:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b791b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f944 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050043.570065:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:1.0:1789050043.570071:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050043.570128:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691525888:12345-192.168.206.1@tcp:103:lfs.0 Request processed in 137us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050043.570136:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:1.0:1789050043.573309:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050043.573903:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526016 00000100:00100000:3.0:1789050043.573912:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526016 00000100:00100000:3.0:1789050043.573963:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:3.0:1789050043.573973:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691526016:12345-192.168.206.1@tcp:58:lfs.0 00010000:00010000:3.0:1789050043.574174:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.574196:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050043.574227:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050043.574475:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789050043.574601:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691526016:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 628us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050043.574609:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:2.0:1789050043.576589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050043.576881:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526144 00000100:00100000:0.0:1789050043.576898:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526144 00000100:00100000:0.0:1789050043.576991:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 111 00000100:00100000:0.0:1789050043.577017:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:10534:x1875954691526144:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050043.577049:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050043.577067:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f975 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577117:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577128:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577146:0:5818:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577161:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577173:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050043.577176:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050043.577180:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050043.577187:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331800, rc 0) 00000100:00100000:0.0:1789050043.577273:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+57:10534:x1875954691526144:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 258us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050043.577279:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 111 00000040:00080000:0.0:1789050044.043773:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050044.043782:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050044.043831:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789050044.043837:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050044.043939:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704120064:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050044.044023:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff950714d17600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050044.044856:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704120448:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.044975:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.045013:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050044.045019:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704119936:0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.045045:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.045229:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704120192:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.045274:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.045295:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704120704:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.045313:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.045332:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050044.045336:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704120320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.045354:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.045381:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120448 00000100:00100000:2.0:1789050044.045386:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120448 00000100:00100000:2.0:1789050044.045427:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120704 00000100:00100000:2.0:1789050044.045430:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120704 00000100:00100000:2.0:1789050044.045447:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050044.045455:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704120448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.045497:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704120448:12345-0@lo:400:kworker.0 Request processed in 43us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.045516:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050044.045534:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050044.045541:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704120704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789050044.045566:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050044.045581:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704120704:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.045587:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050044.045622:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789050044.045627:0:3282:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1789050044.045642:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c19e300, transno 4294967301 00000004:00080000:2.0:1789050044.045651:0:3282:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1789050044.045668:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704120704:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.047308:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120192 00000100:00100000:2.0:1789050044.047318:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120192 00000100:00100000:2.0:1789050044.047365:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120320 00000100:00100000:2.0:1789050044.047369:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120320 00000100:00100000:2.0:1789050044.047405:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789050044.047416:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704120192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.047485:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704120192:12345-0@lo:400:kworker.0 Request processed in 69us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.047493:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789050044.047517:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789050044.047527:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704120320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050044.047549:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704120576:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.047559:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704120320:12345-0@lo:400:kworker.0 Request processed in 35us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.047566:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789050044.047619:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704120320:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.047631:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704120192:0@lo:400:kworker.0 00000100:00080000:1.0:1789050044.047687:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050044.047731:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.047812:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704120448:0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.047884:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704120576 00000100:00100000:2.0:1789050044.047959:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704120576 00000100:00100000:2.0:1789050044.048084:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789050044.048093:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704120576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050044.048132:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704120576:12345-0@lo:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.048138:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1789050044.048164:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050044.048191:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704120576:0@lo:400:kworker.0 00000100:00100000:3.0:1789050044.051906:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704119936 00000100:00100000:3.0:1789050044.051919:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704119936 00000100:00100000:3.0:1789050044.052104:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789050044.052116:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704119936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050044.052227:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704119936:12345-0@lo:400:kworker.0 Request processed in 113us (7180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.052234:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789050044.053044:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704120064:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050044.053179:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704119936:0@lo:400:kworker.0 00000100:00100000:3.0:1789050044.054547:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.054646:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526272 00000100:00100000:0.0:1789050044.054654:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526272 00000100:00100000:0.0:1789050044.054726:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 112 00000100:00100000:0.0:1789050044.054736:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+57:10535:x1875954691526272:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050044.054763:0:5818:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050044.054862:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+57:10535:x1875954691526272:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 128us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.054869:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 112 00000100:00080000:1.0:1789050044.055444:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050044.059187:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.059421:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526400 00000100:00100000:0.0:1789050044.059431:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526400 00000100:00100000:0.0:1789050044.059502:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 113 00000100:00100000:0.0:1789050044.059512:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+57:10535:x1875954691526400:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.059577:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.059593:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.059607:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.059672:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.059694:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.059702:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060060:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060072:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060080:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050044.060119:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789050044.060123:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050044.060135:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060154:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060160:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060166:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060171:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.060175:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060183:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060195:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:0.0:1789050044.060231:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050044.060237:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060243:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79270 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060334:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060341:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060348:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060360:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.060363:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060369:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060378:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff950714b52f00) 00010000:00010000:0.0:1789050044.060380:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050044.060382:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060388:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79277 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060402:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060408:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060414:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060419:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.060422:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060428:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060446:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050044.060448:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050044.060451:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.060456:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7927e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.060551:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+57:10535:x1875954691526400:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 1038us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.060560:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 113 00000100:00100000:3.0:1789050044.064717:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.064824:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526656 00000100:00100000:1.0:1789050044.064833:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526656 00000100:00100000:1.0:1789050044.064890:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:1.0:1789050044.064900:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:10535:x1875954691526656:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050044.064917:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050044.064936:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79285 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f97c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065042:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065057:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065068:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050044.065097:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789050044.065186:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065194:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065236:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065242:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050044.065246:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065573:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065586:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:1.0:1789050044.065589:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050044.065593:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065599:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7928c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065639:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79285 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f97c expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065650:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:1.0:1789050044.065652:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050044.065664:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79285 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f97c expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.065674:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e600, rc 0) 00000100:00100000:1.0:1789050044.065872:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691526656:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 972us (1162us total) trans 4294967401 rc 301/301 00000100:00100000:1.0:1789050044.065880:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:3.0:1789050044.069243:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.069283:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691526784 00000100:00100000:0.0:1789050044.069292:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691526784 00000100:00100000:0.0:1789050044.069349:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:0.0:1789050044.069359:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691526784:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050044.069403:0:8158:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050044.069502:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691526784:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 144us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.069509:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:2.0:1789050044.078647:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.080080:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527040 00000100:00100000:0.0:1789050044.080093:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527040 00000100:00100000:0.0:1789050044.080244:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:0.0:1789050044.080266:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691527040:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.080285:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050044.080288:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789050044.080312:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7922a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f960 expref: 58 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.080344:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050044.080350:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050044.080363:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7929a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f983 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050044.081109:0:5818:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789050044.081361:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b792a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.081376:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b792a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.081386:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b792a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.081440:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b7929a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f983 expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.081457:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b792a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f983 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.081465:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950714b52f00) 00010000:00010000:0.0:1789050044.081468:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050044.081471:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:0.0:1789050044.081659:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+59:10535:x1875954691527040:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1404us (3019us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789050044.081667:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:3.0:1789050044.088146:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.088435:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527296 00000100:00100000:0.0:1789050044.088444:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527296 00000100:00100000:0.0:1789050044.088498:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:0.0:1789050044.088507:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+59:10535:x1875954691527296:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.088565:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050044.088590:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b792a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f983 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088609:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950714b52f00) 00010000:00010000:0.0:1789050044.088619:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050044.088638:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088651:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088662:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088688:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088696:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088703:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088762:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088955:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088978:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088985:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.088989:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.088997:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089006:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050044.089008:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050044.089012:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089018:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b792af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089028:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089034:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089040:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089045:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.089054:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089062:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089070:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x10265fe1 (ffff950714b52400) 00010000:00010000:0.0:1789050044.089073:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050044.089076:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.089081:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b792b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10265fe1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.089191:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691527296:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 683us (1053us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050044.089219:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:2.0:1789050044.098972:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.099123:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527424 00000100:00100000:1.0:1789050044.099133:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527424 00000100:00100000:1.0:1789050044.099265:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:1.0:1789050044.099276:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+58:10535:x1875954691527424:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050044.099294:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050044.099314:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b792bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f98a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099344:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099356:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099367:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099462:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b792bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099484:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.099503:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050044.099506:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050044.099510:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789050044.099570:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+59:10535:x1875954691527424:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 296us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.099577:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:2.0:1789050044.102225:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050044.102452:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527680 00000100:00100000:3.0:1789050044.102461:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527680 00000100:00100000:3.0:1789050044.102510:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:3.0:1789050044.102519:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+59:10535:x1875954691527680:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050044.102589:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.102605:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.102616:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050044.102868:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789050044.102877:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280090676960ns, next at 281090674861ns, rc = 0 00000004:00010000:3.0:1789050044.102959:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000814f2b26 reply state 00000000ef1d8b26 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050044.102982:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050044.103091:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+61:10535:x1875954691527680:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 572us (901us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1789050044.103098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 119 00010000:00010000:1.0:1789050044.105524:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105540:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105547:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105552:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050044.105556:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105563:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105577:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050044.105581:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050044.105585:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.105592:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b792cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.106507:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.106590:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527808 00000100:00100000:0.0:1789050044.106600:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527808 00000100:00100000:0.0:1789050044.106729:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 120 00000100:00100000:0.0:1789050044.106740:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+60:10535:x1875954691527808:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.106762:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050044.106779:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f991 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.107118:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.107274:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.107307:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:0.0:1789050044.107311:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050044.107314:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330e00, rc 0) 00000100:00100000:0.0:1789050044.107365:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+61:10535:x1875954691527808:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 626us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.107372:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 120 00000100:00100000:3.0:1789050044.110813:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.110885:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691527936 00000100:00100000:1.0:1789050044.110895:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691527936 00000100:00100000:1.0:1789050044.110971:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:1.0:1789050044.110988:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691527936:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789050044.111296:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691527936:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 309us (490us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789050044.111304:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00080000:2.0:1789050044.111476:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050044.115025:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.115107:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691528192 00000100:00100000:0.0:1789050044.115117:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691528192 00000100:00100000:0.0:1789050044.115170:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:0.0:1789050044.115179:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+61:10535:x1875954691528192:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050044.115467:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:10535:x1875954691528192:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 288us (447us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1789050044.115474:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:0.0:1789050044.118178:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050044.118349:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691528448 00000100:00100000:3.0:1789050044.118358:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691528448 00000100:00100000:3.0:1789050044.118412:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:3.0:1789050044.118422:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+62:10535:x1875954691528448:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050044.118522:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+62:10535:x1875954691528448:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 101us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.118544:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:3.0:1789050044.122052:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.122190:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691528576 00000100:00100000:1.0:1789050044.122232:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691528576 00000100:00100000:1.0:1789050044.122342:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 122 00000100:00100000:1.0:1789050044.122353:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:10535:x1875954691528576:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050044.122370:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050044.122387:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b792d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f998 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122448:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122461:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122472:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050044.122507:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050044.122523:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122565:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b792d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f998 expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122585:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f998 expref: 63 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.122593:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050044.122596:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789050044.122599:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e400, rc 0) 00000100:00100000:1.0:1789050044.122772:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+63:10535:x1875954691528576:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 420us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.122779:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 122 00000100:00100000:1.0:1789050044.126901:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050044.127051:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691528704 00000100:00100000:2.0:1789050044.127060:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691528704 00000100:00100000:2.0:1789050044.127158:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789050044.127169:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691528704:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050044.127185:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050044.127394:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f99f expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050044.127422:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb8979df7d80, blocks: 0x1 00010000:00010000:2.0:1789050044.127440:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789050044.127459:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050044.127469:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 10 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.127489:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 10 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.127502:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050044.127555:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691528704:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 388us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.127563:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:3.0:1789050044.130487:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.130568:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691528960 00000100:00100000:0.0:1789050044.130576:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691528960 00000100:00100000:0.0:1789050044.130631:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:0.0:1789050044.130639:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+63:10535:x1875954691528960:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789050044.130797:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+63:10535:x1875954691528960:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 157us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.130804:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:3.0:1789050044.133639:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.133756:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529088 00000100:00100000:0.0:1789050044.133765:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529088 00000100:00100000:0.0:1789050044.133926:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:0.0:1789050044.133938:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+10:10535:x1875954691529088:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.133970:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050044.133987:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9a6 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.134015:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.134024:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050044.134027:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050044.134032:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.134062:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.134074:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.134086:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1875954704120832:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050044.134169:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706449f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050044.139922:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.139959:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1875954704120832:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050044.139993:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.140013:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:0.0:1789050044.140086:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:10535:x1875954691529088:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 6151us (6453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.140095:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:1.0:1789050044.140192:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529216 00000100:00100000:1.0:1789050044.140220:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529216 00010000:00010000:1.0:1789050044.140250:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050044.140277:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:1.0:1789050044.140286:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:2348:x1875954691529216:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050044.140298:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050044.140319:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.140331:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.140359:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b792e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f99f expref: 11 pid: 8215 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.140379:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050044.140383:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050044.140390:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.140400:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.140437:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050044.140450:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5801:1875954704120960:192.168.206.1@tcp:105: 00000100:00100000:1.0:1789050044.141151:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050044.144367:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050044.144461:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529344 00000100:00100000:2.0:1789050044.144470:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529344 00002000:00100000:2.0:1789050044.144513:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff95073c7c9f80 x1875954691529344/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:545/0 lens 504/0 e 0 to 0 dl 1789050055 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050044.144524:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c7c9f80 with x1875954691529344 ext(0->12) 00002000:00010000:2.0:1789050044.144529:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c7c9f80 00000100:00100000:2.0:1789050044.144563:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:2.0:1789050044.144573:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+11:2349:x1875954691529344:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789050044.144665:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5801:1875954704120960:192.168.206.1@tcp:105: 00010000:00010000:1.0:1789050044.144692:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050044.144747:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:2348:x1875954691529216:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 4462us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.144756:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:2.0:1789050044.144966:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+12:2349:x1875954691529344:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 Request processed in 388us (601us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789050044.144973:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00002000:00100000:2.0:1789050044.144980:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff95073c7c9f80 x1875954691529344/t4294967308(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:545/0 lens 504/448 e 0 to 0 dl 1789050055 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050044.144988:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c7c9f80 with x1875954691529344 ext(0->12) 00002000:00010000:2.0:1789050044.144997:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c7c9f80 00000100:00100000:2.0:1789050044.148039:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.148126:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529472 00000100:00100000:1.0:1789050044.148135:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529472 00000100:00100000:1.0:1789050044.148275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00100000:1.0:1789050044.148286:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+63:10535:x1875954691529472:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789050044.179141:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967404 is committed 00000004:00080000:0.0:1789050044.179167:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789050044.179219:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789050044.179241:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9506010fecc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789050044.179245:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950728ca0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9506010fe300 00000020:00080000:0.0:1789050044.179248:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c689100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c1c5000 00000020:00080000:0.0:1789050044.179275:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1789050044.179300:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95060597ecc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789050044.179304:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950704f5bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95060597e000 00000020:00080000:0.0:1789050044.179307:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950704f5b400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c4a3400 00000004:00080000:0.0:1789050044.179331:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789050044.179358:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789050044.179554:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789050044.180015:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704121344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789050044.180165:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050044.180180:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704121088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789050044.180224:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050044.180232:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704121216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789050044.180239:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050044.180408:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121344 00000100:00100000:1.0:1789050044.180416:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121344 00000100:00100000:1.0:1789050044.180461:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121088 00000100:00100000:1.0:1789050044.180464:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121088 00000100:00100000:2.0:1789050044.180474:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789050044.180489:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704121344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789050044.180499:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789050044.180508:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704121088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789050044.180526:0:6672:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789050044.180556:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb893bb1d9f5, atime: 0x0, ctime: 0x18d3fb893bb1d9f5, blocks: 0xb 00010000:00010000:1.0:1789050044.180564:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.180580:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=280s v=(0 0) 00010000:00010000:1.0:1789050044.180647:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050044.180655:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.180672:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.180692:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.180717:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050044.180737:0:8215:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:1.0:1789050044.180739:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050044.180742:0:8215:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789050044911809166 00002000:00010000:2.0:1789050044.180747:0:8215:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789050044.180748:0:8215:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789050044870000000 -> 1789050044911809166 00002000:00010000:2.0:1789050044.180751:0:8215:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1789050044.180827:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050044.180833:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.180842:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050044.180846:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.180868:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.180884:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.180891:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2328670/0x9df728c939b792f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.180911:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050044.180913:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050044.180915:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050044.181095:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875954704121344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 611us (930us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789050044.181102:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789050044.181284:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789050044.181324:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c219500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789050044.181330:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704121344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050044.181354:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121216 00000100:00100000:0.0:1789050044.181358:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121216 00000100:00100000:0.0:1789050044.181398:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789050044.181408:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875954704121216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789050044.181424:0:6671:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1789050044.181439:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.181455:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 11 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.181474:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789050044.181478:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050044.181482:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.181523:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 11 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.181539:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 11 pid: 6672 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.181551:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704121472:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050044.181944:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:10535:x1875954691529472:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 33658us (33976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.181953:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00100000:1.0:1789050044.182003:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704121088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1496us (1764us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789050044.182011:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1789050044.182040:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9507375f2a00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789050044.182045:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507375f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704121088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050044.182121:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050044.186179:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.186238:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529600 00000100:00100000:1.0:1789050044.186248:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529600 00000100:00100000:3.0:1789050044.186252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050044.186391:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529728 00000100:00100000:2.0:1789050044.186397:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529728 00010000:00010000:2.0:1789050044.186429:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 13 pid: 6672 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.186557:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:2.0:1789050044.186570:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:2347:x1875954691529728:12345-192.168.206.1@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789050044.186577:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00010000:00010000:2.0:1789050044.186587:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050044.186595:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 13 pid: 6672 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.186608:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 13 pid: 6672 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.186651:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050044.186655:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050044.186661:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.186693:0:5803:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.186722:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050044.186760:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7bba58/0x9df728c939b790b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f905 expref: 13 pid: 6672 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.186772:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+12:2347:x1875954691529728:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 207us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.186775:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704121472:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050044.186779:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:1.0:1789050044.186847:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+12:2348:x1875954691529600:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.187229:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.187241:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.187302:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.187323:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.187332:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.187397:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050044.188437:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3285:x1875954704121216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7028us (7149us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789050044.188447:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1789050044.188502:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c21bb80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789050044.188510:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704121216:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789050044.190068:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050044.190081:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.190095:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050044.190100:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.190111:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.190137:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.190145:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b792fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.190278:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050044.190281:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050044.190283:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789050044.236337:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789050044.236353:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1789050044.236362:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1789050044.236370:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789050044.236553:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691529600:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 49962us (50378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050044.236563:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:3.0:1789050044.239977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.240080:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691529984 00000100:00100000:0.0:1789050044.240090:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691529984 00000100:00100000:0.0:1789050044.240183:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 125 00000100:00100000:0.0:1789050044.240193:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+15:10535:x1875954691529984:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.240888:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050044.240915:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b792e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f998 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.240936:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:0.0:1789050044.240942:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050044.240970:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.240981:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.241006:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050044.241272:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f80cac8b reply state 0000000095568e75 transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.241281:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789050044.241365:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+16:10535:x1875954691529984:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 1173us (1395us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1789050044.241373:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 125 00010000:00010000:3.0:1789050044.243547:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243563:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243571:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243577:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050044.243581:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243589:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243604:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:3.0:1789050044.243607:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050044.243612:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.243618:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050044.248391:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050044.248489:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691530112 00000100:00100000:2.0:1789050044.248627:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691530112 00000100:00100000:2.0:1789050044.248698:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:2.0:1789050044.248709:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691530112:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789050044.249483:0:8215:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789050044.249488:0:8215:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789050044911809166 -> 1789050044241000000 00002000:00010000:2.0:1789050044.249507:0:8215:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789050044000000000 00002000:00010000:2.0:1789050044.249510:0:8215:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789050044911809166 -> 1789050044241000000 00002000:00010000:2.0:1789050044.249513:0:8215:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789050044.249588:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691530112:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 880us (1205us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789050044.249598:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:2.0:1789050044.252751:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.252896:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691530368 00000100:00100000:0.0:1789050044.252906:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691530368 00000100:00100000:0.0:1789050044.252961:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 126 00000100:00100000:0.0:1789050044.252971:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:10535:x1875954691530368:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.253425:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.253443:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.253452:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.253486:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.253500:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 15 pid: 5817 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.253533:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704121600:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050044.253737:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050044.256451:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704121600:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050044.256477:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.258581:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.259434:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691530496 00000100:00100000:1.0:1789050044.259443:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691530496 00010000:00010000:1.0:1789050044.259483:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 16 pid: 5817 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050044.259528:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:1.0:1789050044.259538:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+16:2348:x1875954691530496:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050044.259553:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050044.259559:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 16 pid: 5817 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259585:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 16 pid: 5817 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259607:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b792c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f98a expref: 16 pid: 5817 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259625:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050044.259631:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259640:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259647:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.259691:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050044.259751:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+15:2348:x1875954691530496:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 213us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.259759:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00010000:00010000:0.0:1789050044.260119:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260129:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260154:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260161:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260167:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260174:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050044.260178:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260186:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260196:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:0.0:1789050044.260247:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789050044.260252:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.260259:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b7930a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.260306:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:10535:x1875954691530368:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 Request processed in 7336us (7562us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789050044.260315:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 126 00000100:00100000:2.0:1789050044.264114:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.264191:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691530624 00000100:00100000:0.0:1789050044.264575:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691530624 00000100:00100000:0.0:1789050044.264622:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:0.0:1789050044.264632:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691530624:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789050044.264672:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.264702:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.264709:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050044.264713:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050044.264717:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.264750:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.264783:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 7 pid: 6670 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.264797:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704121728:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050044.264883:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050044.268700:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704121728:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050044.268733:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.269966:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050044.270059:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691530752 00000100:00100000:1.0:1789050044.270068:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691530752 00010000:00010000:1.0:1789050044.270105:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 8 pid: 6670 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050044.270142:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:1.0:1789050044.270151:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691530752:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050044.270179:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050044.270261:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 8 pid: 6670 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.270275:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 8 pid: 6670 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.270297:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b792ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9a6 expref: 8 pid: 6670 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.270384:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050044.270390:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050044.270396:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.270407:0:5803:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050044.270429:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050044.270473:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691530752:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 323us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.270480:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 58 00010000:00010000:0.0:1789050044.270635:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270645:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270668:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270689:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270697:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270718:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050044.270722:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270732:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270746:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.270753:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e220840f/0x9df728c939b79311 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.270813:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691530624:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 6182us (6707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.270821:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:1.0:1789050044.274924:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050044.274993:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531008 00000100:00100000:3.0:1789050044.275003:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531008 00000100:00100000:3.0:1789050044.275227:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 127 00000100:00100000:3.0:1789050044.275238:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+14:10535:x1875954691531008:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789050044.275490:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275506:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275523:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275720:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275804:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275812:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275845:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.275857:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 15 pid: 5818 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050044.275889:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704121856:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050044.275958:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789050044.279130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.279191:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531136 00000100:00100000:0.0:1789050044.279218:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531136 00010000:00010000:0.0:1789050044.279255:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 16 pid: 5818 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.279298:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:0.0:1789050044.279308:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+16:2347:x1875954691531136:12345-192.168.206.1@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789050044.279447:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704121856:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050044.279458:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050044.279473:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.279473:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 16 pid: 5818 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.279496:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 16 pid: 5818 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.280461:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b792d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f991 expref: 16 pid: 5818 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.280480:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:0.0:1789050044.280486:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.280495:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.280502:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.280832:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050044.280900:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:2347:x1875954691531136:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 1585us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.280911:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00010000:00010000:2.0:1789050044.282407:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.282421:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050044.283482:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1789050044.283792:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000001:00080000:2.0:1789050044.284395:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1789050044.284479:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704121984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050044.284626:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.284712:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050044.284753:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704121984 00000100:00100000:1.0:1789050044.284761:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704121984 00000100:00100000:1.0:1789050044.284883:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050044.284953:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704121984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789050044.285177:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704121984:12345-0@lo:1000:mdt00_003.0 Request processed in 226us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050044.285185:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050044.285467:0:8158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789050044.285473:0:8158:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1789050044.285491:0:8158:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c219500, transno 4294967309 00000004:00080000:3.0:1789050044.285540:0:8158:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c21bb80, transno 4294967310 00000100:00100000:3.0:1789050044.286417:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704121984:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789050044.287374:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00000100:00100000:2.0:1789050044.287452:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704122112:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050044.287507:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050044.287656:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050044.287703:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122112 00000100:00100000:0.0:1789050044.287710:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122112 00000100:00100000:0.0:1789050044.287795:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789050044.287805:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704122112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050044.288143:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8158:x1875954704122112:12345-0@lo:1000:mdt00_003.0 Request processed in 339us (635us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789050044.288150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050044.288405:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704122112:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789050044.288446:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288456:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288462:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288468:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050044.288472:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288479:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288493:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff950732cb4000) 00010000:00010000:2.0:1789050044.288496:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050044.288500:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288505:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7931f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288607:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288615:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288621:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288636:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050044.288640:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288646:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288655:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050044.288658:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050044.288665:0:8158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288689:0:8158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288698:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.288725:0:8158:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.288736:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704122240:192.168.206.1@tcp:105: 00000100:00100000:2.0:1789050044.288858:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050044.294144:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704122240:192.168.206.1@tcp:105: 00010000:00010000:2.0:1789050044.294178:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294279:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79262 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294380:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294397:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294410:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294422:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294428:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294434:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294440:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050044.294444:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294451:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294467:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050044.294471:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050044.294475:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294491:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294502:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294508:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.294514:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.295122:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050044.295127:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.295133:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.295143:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050044.295146:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050044.295149:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.295156:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79318 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050044.295828:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.295988:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531264 00000100:00100000:0.0:1789050044.295996:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531264 00000100:00100000:0.0:1789050044.296044:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:0.0:1789050044.296067:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:10534:x1875954691531264:12345-192.168.206.1@tcp:49:lfs.0 00000100:00100000:0.0:1789050044.296175:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:10534:x1875954691531264:12345-192.168.206.1@tcp:49:lfs.0 Request processed in 122us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.296182:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:2.0:1789050044.296824:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+18:10535:x1875954691531008:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 21584us (21904us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789050044.296836:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 127 00000040:00080000:0.0:1789050044.296838:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050044.296843:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000020:00080000:2.0:1789050044.296852:0:8158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789050044.297470:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789050044.297479:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050044.303293:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050044.304929:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531520 00000100:00100000:3.0:1789050044.304942:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531520 00000100:00100000:3.0:1789050044.305007:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 128 00000100:00100000:3.0:1789050044.305018:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+18:10534:x1875954691531520:12345-192.168.206.1@tcp:58:lfs.0 00000040:00080000:3.0:1789050044.305488:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789050044.305580:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+18:10534:x1875954691531520:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 563us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.305588:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 128 00000100:00100000:2.0:1789050044.306427:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050044.306492:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531776 00000100:00100000:3.0:1789050044.306500:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531776 00000100:00100000:3.0:1789050044.306540:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:3.0:1789050044.306550:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+18:10535:x1875954691531776:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789050044.307800:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789050044.307913:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967411 00010000:00010000:2.0:1789050044.307970:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.307985:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.307996:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.308005:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.308011:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.308018:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050044.308043:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789050044.308150:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:10535:x1875954691531776:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 1599us (1723us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789050044.308158:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000020:00080000:2.0:1789050044.308163:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789050044.308421:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050044.308428:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.308435:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050044.308446:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.308454:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.308465:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95072c9b1300) 00010000:00010000:3.0:1789050044.308468:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789050044.308473:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.308479:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7932d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.308496:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050044.308498:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050044.308500:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050044.334096:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.334449:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691531904 00000100:00100000:0.0:1789050044.334459:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691531904 00000100:00100000:0.0:1789050044.334516:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00100000:0.0:1789050044.334531:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:10537:x1875954691531904:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050044.334556:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050044.334575:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9ad expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334633:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334648:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334660:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334674:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334712:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334720:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334943:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334955:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 21 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.334963:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.335007:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 21 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.335020:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 21 pid: 8158 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.335033:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704122368:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050044.335127:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050044.339632:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050044.339999:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532160 00000100:00100000:2.0:1789050044.340008:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532160 00000100:00100000:2.0:1789050044.340070:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:2.0:1789050044.340080:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+22:5589:x1875954691532160:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789050044.340100:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704122368:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050044.340129:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050044.340525:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:5589:x1875954691532160:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 445us (900us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789050044.340532:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:3.0:1789050044.343834:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050044.344138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532288 00000100:00100000:0.0:1789050044.344159:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532288 00010000:00010000:0.0:1789050044.344196:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 23 pid: 8158 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050044.344394:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:0.0:1789050044.344405:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:2347:x1875954691532288:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050044.344420:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050044.344427:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 23 pid: 8158 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344440:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 23 pid: 8158 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344460:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f96e expref: 23 pid: 8158 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344473:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:0.0:1789050044.344477:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344484:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344489:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050044.344547:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050044.344595:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+22:2347:x1875954691532288:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 192us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050044.344621:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00010000:00010000:3.0:1789050044.344842:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344851:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050044.344907:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789050044.344911:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050044.344930:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344943:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344952:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344966:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344972:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344978:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050044.344982:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344989:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.344999:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050044.345001:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050044.345005:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345010:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7933b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345023:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345029:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345035:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345040:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050044.345049:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345056:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345064:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff950714b52400) 00010000:00010000:3.0:1789050044.345078:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050044.345082:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345094:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331200/0x9df728c939b79342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345139:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ad expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345153:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ad expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050044.345160:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050044.345162:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050044.345164:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331e00, rc 0) 00000100:00100000:3.0:1789050044.345191:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:10537:x1875954691531904:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 10667us (11104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.345823:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 129 00010000:00010000:0.0:1789050044.555773:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050044.555930:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050044.555954:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704122496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050044.556018:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050044.556181:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122496 00000100:00100000:3.0:1789050044.556188:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122496 00000100:00100000:3.0:1789050044.556266:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789050044.556276:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704122496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050044.556306:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:3.0:1789050044.556362:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704122496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050044.556369:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789050044.556515:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704122496:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789050045.053642:0:12090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050045.053650:0:12090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050045.054516:0:12090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789050045.054524:0:12090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050045.132554:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.132639:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.132681:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050045.133814:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532672 00000100:00100000:1.0:1789050045.133824:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532672 00000100:00100000:1.0:1789050045.133879:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:1.0:1789050045.133889:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691532672:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050045.133961:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691532672:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 74us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050045.133968:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:2.0:1789050045.134663:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.134796:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.134835:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532928 00000100:00100000:2.0:1789050045.134841:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532928 00000100:00100000:2.0:1789050045.134878:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532544 00000100:00100000:2.0:1789050045.134881:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532544 00000100:00100000:2.0:1789050045.134902:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:2.0:1789050045.134911:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691532928:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050045.134950:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691532928:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 40us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050045.134957:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:2.0:1789050045.134972:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:2.0:1789050045.134979:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:2348:x1875954691532544:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050045.135008:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:2348:x1875954691532544:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 30us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050045.135029:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:2.0:1789050045.135049:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532800 00000100:00100000:2.0:1789050045.135053:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532800 00000100:00100000:2.0:1789050045.135076:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:2.0:1789050045.135083:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691532800:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050045.135108:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691532800:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050045.135114:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00080000:2.0:1789050045.135129:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050045.135134:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050045.137947:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691532416 00000100:00100000:0.0:1789050045.137958:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691532416 00000100:00100000:1.0:1789050045.138438:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 279 00000100:00100000:1.0:1789050045.138448:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691532416:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050045.138517:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691532416:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 71us (5973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050045.138524:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 279 00000040:00080000:0.0:1789050045.323923:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050045.323931:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050045.324038:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789050045.324048:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050045.324163:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704122624:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050045.324340:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff950714d17600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050045.330037:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704122624:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050045.330826:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050045.333385:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691533056 00000100:00100000:3.0:1789050045.333398:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691533056 00000100:00100000:3.0:1789050045.333525:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 130 00000100:00100000:3.0:1789050045.333535:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:10550:x1875954691533056:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050045.333566:0:5817:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789050045.333668:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:10550:x1875954691533056:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 134us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050045.333686:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 130 00000100:00100000:1.0:1789050045.340791:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.340881:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691533312 00000100:00100000:2.0:1789050045.340891:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691533312 00000100:00100000:2.0:1789050045.340949:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 131 00000100:00100000:2.0:1789050045.340958:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:10550:x1875954691533312:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050045.340986:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050045.341006:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79350 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9b4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.341090:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.341104:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.341117:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050045.341144:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789050045.341449:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79350 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9b4 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.341469:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9b4 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.341477:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050045.341480:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050045.341483:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50400, rc 0) 00000100:00100000:2.0:1789050045.341584:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+23:10550:x1875954691533312:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 626us (800us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789050045.341591:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 131 00000100:00100000:0.0:1789050045.352051:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050045.352094:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050045.352174:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691533696 00000100:00100000:2.0:1789050045.352184:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691533696 00000100:00100000:2.0:1789050045.352279:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 132 00000100:00100000:2.0:1789050045.352290:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+23:10550:x1875954691533696:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050045.352360:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352377:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352388:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352553:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352574:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352581:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352587:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050045.352591:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352599:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352611:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050045.352614:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050045.352618:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050045.352624:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050045.352939:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+24:10550:x1875954691533696:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 650us (842us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789050045.352948:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 132 00000040:00080000:1.0:1789050045.353126:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050045.353132:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050045.353603:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789050045.353613:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050045.354238:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691533440 00000100:00100000:3.0:1789050045.354254:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691533440 00000100:00100000:3.0:1789050045.354304:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789050045.354313:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+24:2347:x1875954691533440:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050045.354324:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050045.354343:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9b4 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050045.354358:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050045.354362:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050045.354400:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:2347:x1875954691533440:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 88us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050045.354407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:0.0:1789050045.359937:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050045.360017:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691533952 00000100:00100000:3.0:1789050045.360039:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691533952 00000100:00100000:3.0:1789050045.360088:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:3.0:1789050045.360097:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:10550:x1875954691533952:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050045.360341:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+24:10550:x1875954691533952:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 245us (413us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789050045.360348:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00010000:00010000:3.0:1789050045.579491:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050046.606289:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050046.901882:0:12141:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050046.901897:0:12141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050046.901949:0:12141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789050046.901966:0:12141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050047.074060:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050047.074167:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534208 00000100:00100000:3.0:1789050047.074177:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534208 00000100:00100000:3.0:1789050047.074273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00100000:3.0:1789050047.074285:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+24:10570:x1875954691534208:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050047.074308:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050047.074328:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7936c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789050047.074331:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050047.074423:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b79373 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050047.074437:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b79373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050047.074462:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b79373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050047.074476:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789050047.074613:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7936c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9bb expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050047.074646:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b79373 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9bb expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050047.074655:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050047.074658:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050047.074672:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:3.0:1789050047.074730:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:10570:x1875954691534208:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 448us (678us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789050047.074738:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00100000:1.0:1789050047.078511:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050047.078562:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534336 00000100:00100000:2.0:1789050047.078581:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534336 00000100:00100000:2.0:1789050047.078627:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 134 00000100:00100000:2.0:1789050047.078637:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+26:10570:x1875954691534336:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050047.078717:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078733:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078743:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078766:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078772:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078791:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078796:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050047.078800:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078807:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078817:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:2.0:1789050047.078820:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050047.078825:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050047.078832:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050047.078911:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+26:10570:x1875954691534336:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 274us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050047.078918:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 134 00000100:00100000:2.0:1789050047.115729:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704122752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050047.115792:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050047.115969:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122752 00000100:00100000:3.0:1789050047.115978:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122752 00000100:00100000:3.0:1789050047.116036:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050047.116045:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704122752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050047.116086:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050047.116135:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704122752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050047.116142:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050047.116182:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704122752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789050047.116435:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050047.179530:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050047.179908:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534464 00000100:00100000:1.0:1789050047.179918:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534464 00000100:00100000:1.0:1789050047.180096:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789050047.180107:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691534464:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:1.0:1789050047.180123:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050047.180143:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79388 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9c2 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050047.180168:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb895461b640, atime: 0x18d3fb8946045800, ctime: 0x18d3fb895461b640, blocks: 0xb 00010000:00010000:1.0:1789050047.180185:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1789050047.180190:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050047.180245:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c2 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050047.180266:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c2 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050047.180279:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e200, rc 0) 00000100:00100000:1.0:1789050047.180327:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2349:x1875954691534464:12345-192.168.206.1@tcp:101:cat.0 Request processed in 223us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050047.180334:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00080000:2.0:1789050047.180602:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050047.193427:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050047.194760:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534592 00000100:00100000:2.0:1789050047.194771:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534592 00002000:00100000:2.0:1789050047.194824:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff95073c25aa00 x1875954691534592/t0(0) o3->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:548/0 lens 488/0 e 0 to 0 dl 1789050058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050047.194834:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c25aa00 with x1875954691534592 ext(0->4095) 00002000:00010000:2.0:1789050047.194840:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c25aa00 00000100:00100000:2.0:1789050047.194875:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789050047.194885:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691534592:12345-192.168.206.1@tcp:3:cat.0 00000100:00100000:2.0:1789050047.195091:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691534592:12345-192.168.206.1@tcp:3:cat.0 Request processed in 207us (1671us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789050047.195099:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00002000:00100000:2.0:1789050047.195107:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff95073c25aa00 x1875954691534592/t0(0) o3->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:548/0 lens 488/4536 e 0 to 0 dl 1789050058 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050047.195115:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c25aa00 with x1875954691534592 ext(0->4095) 00002000:00010000:2.0:1789050047.195119:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c25aa00 00010000:00010000:0.0:1789050047.629332:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050048.651987:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789050048.744641:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1789050049.165299:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704122880:0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.165357:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704123136:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.165428:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704123008:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.165682:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.165759:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704123392:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.165787:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.165866:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704122880 00000100:00100000:2.0:1789050049.165874:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704122880 00000100:00100000:2.0:1789050049.165924:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789050049.165934:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704122880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166114:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704122880:12345-0@lo:400:kworker.0 Request processed in 180us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.166122:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789050049.166160:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123264:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166188:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.166243:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123264 00000100:00100000:2.0:1789050049.166248:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123264 00000100:00100000:2.0:1789050049.166284:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050049.166291:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166330:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704123264:12345-0@lo:400:kworker.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.166337:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789050049.166354:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050049.166390:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123264:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166415:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704122880:0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166442:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123392 00000100:00100000:2.0:1789050049.166446:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123392 00000100:00100000:2.0:1789050049.166482:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789050049.166490:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050049.166534:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704123392:12345-0@lo:400:kworker.0 Request processed in 46us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.166541:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789050049.166560:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050049.166575:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704123392:0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.167065:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050049.167105:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123136 00000100:00100000:3.0:1789050049.167109:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123136 00000100:00100000:3.0:1789050049.167144:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789050049.167151:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704123136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.167195:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704123136:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050049.167217:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789050049.167475:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050049.167503:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704123136:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.170904:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.170981:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704123520:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.171022:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050049.171089:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123520 00000100:00100000:1.0:1789050049.171110:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123520 00000100:00100000:1.0:1789050049.171177:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789050049.171185:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123008 00000100:00100000:1.0:1789050049.171188:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704123520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050049.171190:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123008 00000100:00100000:3.0:1789050049.171242:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789050049.171248:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704123008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.171275:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704123520:12345-0@lo:400:kworker.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050049.171281:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789050049.171285:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704123008:12345-0@lo:400:kworker.0 Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050049.171290:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789050049.171307:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050049.171341:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704123008:0@lo:400:kworker.0 00000100:00100000:1.0:1789050049.171352:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789050049.171358:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9507375f2a00, transno 4294967304 00000100:00100000:1.0:1789050049.171375:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704123520:0@lo:400:kworker.0 00000001:00080000:0.0:1789050049.248333:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967405 is committed 00000020:00080000:0.0:1789050049.248356:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789050049.248372:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789050049.248387:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95060597e000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789050049.248392:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950704f5be00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950709c2ccc0 00000020:00080000:0.0:1789050049.248395:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950704f5bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c1fd800 00000001:00080000:0.0:1789050049.248429:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789050049.248455:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789050049.248776:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789050049.675495:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050049.675557:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050049.675584:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050049.675682:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050049.675736:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123648 00000100:00100000:2.0:1789050049.675747:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123648 00000100:00100000:2.0:1789050049.675812:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050049.675824:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704123648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050049.675867:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050049.675924:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704123648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050049.675931:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789050049.676027:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123648:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789050049.772795:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1789050049.772822:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1789050050.251861:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050050.251911:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050050.251946:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050050.251980:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050050.252003:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050050.252037:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534976 00000100:00100000:2.0:1789050050.252049:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534976 00000100:00100000:2.0:1789050050.252115:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535104 00000100:00100000:2.0:1789050050.252120:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535104 00000100:00100000:2.0:1789050050.252148:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:2.0:1789050050.252161:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691534976:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050050.252359:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:3.0:1789050050.252369:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691535104:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050050.252424:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534720 00000100:00100000:0.0:1789050050.252429:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534720 00000100:00100000:3.0:1789050050.252450:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691535104:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 82us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050050.252537:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 281 00000100:00100000:0.0:1789050050.252544:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691534720:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050050.252569:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:0.0:1789050050.252572:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691534720:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050050.252577:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 281 00000100:00100000:3.0:1789050050.252597:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535232 00000100:00100000:3.0:1789050050.252601:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535232 00000100:00100000:3.0:1789050050.252639:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691534848 00000100:00100000:3.0:1789050050.252651:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691534848 00000100:00100000:3.0:1789050050.252676:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:3.0:1789050050.252683:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691535232:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050050.252713:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691535232:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050050.252726:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:1.0:1789050050.252736:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00100000:1.0:1789050050.252745:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+13:2348:x1875954691534848:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050050.252773:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+13:2348:x1875954691534848:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 31us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050050.252780:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 124 00000100:00080000:1.0:1789050050.252798:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050050.252803:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050050.252806:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050050.254370:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691534976:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 2199us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050050.254384:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 70 00010000:00010000:0.0:1789050050.700556:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050051.724789:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050051.830611:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050051.830730:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535360 00000100:00100000:0.0:1789050051.830739:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535360 00000100:00100000:0.0:1789050051.830798:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 135 00000100:00100000:0.0:1789050051.830808:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:10215:x1875954691535360:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789050051.830965:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:10215:x1875954691535360:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050051.830972:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 135 00000100:00100000:3.0:1789050051.837424:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050051.837574:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535616 00000100:00100000:2.0:1789050051.837584:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535616 00000100:00100000:2.0:1789050051.837649:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:2.0:1789050051.837659:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:10215:x1875954691535616:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789050051.838154:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:10215:x1875954691535616:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 495us (737us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789050051.838162:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:0.0:1789050052.235473:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050052.235556:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050052.235732:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123776 00000100:00100000:3.0:1789050052.235741:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123776 00000100:00080000:1.0:1789050052.235808:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050052.235809:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050052.235821:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704123776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050052.235852:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050052.235903:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704123776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050052.235909:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789050052.236036:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789050052.236042:0:3283:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789050052.236071:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704123776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789050052.747723:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050053.583277:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050053.583288:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050053.583743:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789050053.583752:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789050053.773010:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050054.256983:0:12341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:20:53 (1789050053) 00000100:00100000:0.0:1789050054.283604:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704124288:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.283677:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050054.283740:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050054.283747:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704124160:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.283772:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050054.283801:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124288 00000100:00100000:0.0:1789050054.283808:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124288 00000100:00100000:0.0:1789050054.283859:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789050054.283868:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704124288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.283913:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704124288:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050054.283920:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789050054.283940:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124160 00000100:00100000:0.0:1789050054.283944:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124160 00000100:00100000:0.0:1789050054.283968:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789050054.283975:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704124160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.284005:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704124160:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050054.284011:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789050054.284027:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050054.284031:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050054.284056:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704124160:0@lo:400:kworker.0 00000100:00100000:0.0:1789050054.284067:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704124288:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284122:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704124032:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284149:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050054.284170:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704124544:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284186:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050054.284283:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789050054.284289:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704123904:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284315:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050054.284330:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704124416:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284346:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050054.284366:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124544 00000100:00100000:1.0:1789050054.284370:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124544 00000100:00100000:1.0:1789050054.284393:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789050054.284400:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284429:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704124544:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050054.284435:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789050054.284451:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124032 00000100:00100000:1.0:1789050054.284455:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124032 00000100:00100000:1.0:1789050054.284472:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124416 00000100:00100000:1.0:1789050054.284474:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124416 00000100:00100000:1.0:1789050054.284490:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789050054.284495:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284522:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704124032:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050054.284527:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789050054.284538:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789050054.284551:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507375f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284579:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507375f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704124416:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050054.284584:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789050054.284611:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704124416:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284634:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704124032:0@lo:400:kworker.0 00000100:00100000:1.0:1789050054.284646:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704124544:0@lo:400:kworker.0 00000100:00080000:0.0:1789050054.287726:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050054.287736:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050054.288059:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704123904 00000100:00100000:3.0:1789050054.288070:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704123904 00000100:00100000:3.0:1789050054.288152:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789050054.288162:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704123904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050054.288263:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704123904:12345-0@lo:400:kworker.0 Request processed in 103us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050054.288270:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789050054.288392:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704123904:0@lo:400:kworker.0 00000020:00080000:0.0:1789050054.353229:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1789050054.353256:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:0.0:1789050054.353276:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789050054.353286:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789050054.796395:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050054.796524:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050054.796585:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050054.797220:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124672 00000100:00100000:2.0:1789050054.797229:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124672 00000100:00100000:2.0:1789050054.797279:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789050054.797289:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704124672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050054.797321:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050054.797377:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704124672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050054.797384:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789050054.797422:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050055.374889:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050055.374941:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050055.374971:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535744 00000100:00100000:3.0:1789050055.374979:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050055.374982:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535744 00000100:00100000:3.0:1789050055.375002:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050055.375025:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050055.375055:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 283 00000100:00100000:0.0:1789050055.375068:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691535744:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050055.375071:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536000 00000100:00100000:3.0:1789050055.375077:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536000 00000100:00100000:3.0:1789050055.375115:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536128 00000100:00100000:3.0:1789050055.375119:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536128 00000100:00100000:0.0:1789050055.375137:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691535744:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050055.375141:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:0.0:1789050055.375153:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 283 00000100:00100000:3.0:1789050055.375160:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691536000:12345-192.168.206.1@tcp:400:kworker.0 00000100:00080000:0.0:1789050055.375230:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050055.375234:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050055.376661:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536256 00000100:00100000:2.0:1789050055.376673:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536256 00000100:00100000:2.0:1789050055.376753:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691535872 00000100:00100000:2.0:1789050055.376756:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691535872 00000100:00100000:2.0:1789050055.376786:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 128 00000100:00100000:2.0:1789050055.376809:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691536256:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050055.376870:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691536256:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 63us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050055.376876:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 128 00000100:00100000:2.0:1789050055.376892:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00100000:2.0:1789050055.376897:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:2349:x1875954691535872:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050055.377086:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:2349:x1875954691535872:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 188us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050055.377093:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00100000:2.0:1789050055.377117:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:2.0:1789050055.377125:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691536128:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050055.377146:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691536128:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 23us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050055.377151:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00080000:0.0:1789050055.377286:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050055.379410:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2349:x1875954691536000:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 46us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050055.379433:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:3.0:1789050055.638028:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050055.638130:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536512 00000100:00100000:2.0:1789050055.638140:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536512 00000100:00100000:2.0:1789050055.638237:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 136 00000100:00100000:2.0:1789050055.638247:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+13:11280:x1875954691536512:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050055.638264:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050055.638283:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7938f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9c9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638350:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638382:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638394:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638452:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638459:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638465:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638711:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b793a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638721:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b793a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638728:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b793a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050055.638738:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789050055.638874:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638882:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638888:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638900:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050055.638904:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638911:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638924:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507114dc400) 00010000:00010000:2.0:1789050055.638927:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050055.638932:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638937:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79396 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638949:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638954:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638961:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638966:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050055.638969:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638975:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.638992:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95072c9b1700) 00010000:00010000:2.0:1789050055.638994:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050055.638997:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.639003:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b7939d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.639395:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7938f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c9 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.639409:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b793a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c9 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050055.639416:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:2.0:1789050055.639418:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050055.639420:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:2.0:1789050055.639589:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+15:11280:x1875954691536512:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1342us (1570us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789050055.639596:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 136 00000100:00100000:2.0:1789050055.647182:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050055.647408:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536640 00000100:00100000:0.0:1789050055.647418:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536640 00000100:00100000:0.0:1789050055.647479:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 137 00000100:00100000:0.0:1789050055.647490:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:11280:x1875954691536640:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789050055.647586:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:11280:x1875954691536640:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050055.647594:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 137 00000100:00100000:3.0:1789050055.659085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050055.659246:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536768 00000100:00100000:0.0:1789050055.659256:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536768 00000100:00100000:0.0:1789050055.659323:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789050055.659332:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:2347:x1875954691536768:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050055.659347:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050055.659369:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b793a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c9 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050055.659399:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:0.0:1789050055.659404:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050055.659456:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:2347:x1875954691536768:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050055.659463:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00010000:00010000:2.0:1789050055.819375:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050056.651380:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050056.651390:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050056.651425:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789050056.651434:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789050056.843401:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050057.355870:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704124800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050057.355949:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050057.356055:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704124800 00000100:00100000:1.0:1789050057.356062:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704124800 00000100:00100000:1.0:1789050057.356116:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789050057.356128:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704124800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050057.356163:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050057.356683:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704124800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 558us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.356691:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789050057.356762:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704124800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789050057.356786:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050057.422706:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.423762:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691536896 00000100:00100000:2.0:1789050057.423773:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691536896 00000100:00100000:2.0:1789050057.423846:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 138 00000100:00100000:2.0:1789050057.423861:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:11322:x1875954691536896:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050057.423888:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050057.423906:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b793b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.423961:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.423974:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.423987:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424001:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424008:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424015:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424190:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424226:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424234:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424241:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050057.424250:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424258:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424270:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:2.0:1789050057.424273:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.424278:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424285:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424297:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424302:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424308:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424313:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050057.424316:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424321:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424328:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95072c9b1700) 00010000:00010000:2.0:1789050057.424330:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.424338:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424344:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424374:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b793b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9d0 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424383:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:2.0:1789050057.424385:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.424389:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b793b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9d0 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.424397:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050057.424462:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+14:11322:x1875954691536896:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 608us (1765us total) trans 0 rc 301/301 00000100:00100000:2.0:1789050057.424471:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 138 00000100:00080000:3.0:1789050057.425138:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050057.432587:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.432697:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537152 00000100:00100000:1.0:1789050057.432707:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537152 00000100:00100000:1.0:1789050057.432764:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 139 00000100:00100000:1.0:1789050057.432776:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+14:11322:x1875954691537152:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:1.0:1789050057.432824:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050057.432849:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b78d3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f810 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433002:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507114dc700) 00010000:00010000:1.0:1789050057.433011:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050057.433635:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433649:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433658:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433669:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433676:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.433682:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050057.437004:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789050057.437020:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437030:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437038:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437044:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050057.437056:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437065:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437080:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:1.0:1789050057.437083:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050057.437088:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.437094:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050057.437115:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000168e186e reply state 000000002e253acb transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050057.438135:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050057.438251:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+15:11322:x1875954691537152:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 5473us (5667us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789050057.438260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 139 00010000:00010000:2.0:1789050057.443647:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443663:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443671:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443676:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050057.443681:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443694:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443709:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff950732cb4900) 00010000:00010000:2.0:1789050057.443712:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.443716:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.443721:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b793ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050057.529564:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.529632:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537280 00000100:00100000:1.0:1789050057.529642:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537280 00000100:00100000:1.0:1789050057.529694:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 140 00000100:00100000:1.0:1789050057.529703:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+14:11330:x1875954691537280:12345-192.168.206.1@tcp:101:lctl.0 00010000:00010000:1.0:1789050057.529725:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050057.529743:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9d7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529815:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529840:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529853:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050057.529886:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789050057.529889:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050057.529907:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529928:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9d7 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529945:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9d7 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.529953:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:1.0:1789050057.529956:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050057.529959:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e400, rc 0) 00000100:00100000:1.0:1789050057.530016:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+15:11330:x1875954691537280:12345-192.168.206.1@tcp:101:lctl.0 Request processed in 314us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.530022:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 140 00000100:00100000:3.0:1789050057.590137:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.593625:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537408 00000100:00100000:2.0:1789050057.593641:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537408 00000100:00100000:2.0:1789050057.593733:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 141 00000100:00100000:2.0:1789050057.593746:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+15:11336:x1875954691537408:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050057.593767:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050057.593793:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b793e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9de expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593865:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593880:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593892:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593907:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593929:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.593936:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594048:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594060:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594067:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050057.594093:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789050057.594097:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050057.594114:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594126:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594134:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594141:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594148:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050057.594152:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594166:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594178:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:2.0:1789050057.594181:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.594186:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594192:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b793ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594251:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594258:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594265:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594270:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050057.594273:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594280:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594287:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95072c9b1700) 00010000:00010000:2.0:1789050057.594290:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050057.594293:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594309:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b793f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594340:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b793e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9de expref: 17 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594353:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9de expref: 16 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.594360:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050057.594363:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050057.594365:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50000, rc 0) 00000100:00100000:2.0:1789050057.594451:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+16:11336:x1875954691537408:12345-192.168.206.1@tcp:101:bash.0 Request processed in 703us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.594459:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 141 00000100:00100000:3.0:1789050057.599303:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.599659:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537664 00000100:00100000:1.0:1789050057.599668:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537664 00000100:00100000:1.0:1789050057.599730:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 142 00000100:00100000:1.0:1789050057.599740:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+16:11336:x1875954691537664:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050057.599758:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050057.599790:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9e5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.599906:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.599922:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.599932:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.599987:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.599995:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600001:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789050057.600548:0:5819:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789050057.600721:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600730:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600738:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600769:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600786:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600792:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600798:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050057.600803:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600810:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600822:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050057.600825:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050057.600829:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600835:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050057.600849:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a01f8d0b reply state 00000000b415515c transno 4294967421 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050057.600858:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789050057.600885:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b793ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600898:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.600916:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050057.600918:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050057.600920:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789050057.600991:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:11336:x1875954691537664:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1252us (1697us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789050057.601001:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 142 00010000:00010000:1.0:1789050057.604327:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604345:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604352:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604358:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050057.604362:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604370:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604387:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4500) 00010000:00010000:1.0:1789050057.604390:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050057.604395:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.604401:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7940d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050057.606026:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.606251:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537792 00000100:00100000:2.0:1789050057.606261:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537792 00000100:00100000:2.0:1789050057.606319:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:2.0:1789050057.606329:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691537792:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050057.606345:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050057.606365:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9ec expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050057.606394:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050057.606412:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1789050057.606416:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050057.606435:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.606455:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.606467:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050057.606540:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691537792:12345-192.168.206.1@tcp:101:bash.0 Request processed in 212us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.606547:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00080000:3.0:1789050057.606875:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050057.609654:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050057.609816:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691537920 00000100:00100000:3.0:1789050057.609825:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691537920 00000100:00100000:3.0:1789050057.610020:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:3.0:1789050057.610031:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:11336:x1875954691537920:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050057.610047:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050057.610063:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9f3 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.610110:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.610119:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050057.610123:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050057.610128:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.610159:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.610172:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 7 pid: 6671 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050057.610338:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875954704124928:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050057.610463:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704e98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050057.616854:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.617982:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691538048 00000100:00100000:2.0:1789050057.617993:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691538048 00010000:00010000:2.0:1789050057.618037:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 8 pid: 6671 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050057.618086:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050057.618105:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691538048:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050057.618122:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050057.618145:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 8 pid: 6671 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.618160:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 8 pid: 6671 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050057.618180:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875954704124928:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050057.618184:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79422 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ec expref: 8 pid: 6671 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.618239:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.618241:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050057.618249:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050057.618263:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.618273:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.621294:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07400, rc 0) 00000100:00100000:1.0:1789050057.621391:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:11336:x1875954691537920:12345-192.168.206.1@tcp:101:bash.0 Request processed in 11355us (11739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.621400:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00010000:00010000:0.0:1789050057.621731:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050057.621750:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073d0a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1875954704125056:192.168.206.1@tcp:105: 00000100:00100000:0.0:1789050057.621843:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288300 going to sleep for 11 seconds 00000100:00100000:2.0:1789050057.625685:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073d0a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1875954704125056:192.168.206.1@tcp:105: 00010000:00010000:2.0:1789050057.625709:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050057.625763:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691538048:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 7668us (8918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.625774:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050057.630687:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050057.630847:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691538304 00000100:00100000:3.0:1789050057.630858:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691538304 00000100:00100000:3.0:1789050057.630919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050057.630930:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+18:11336:x1875954691538304:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:3.0:1789050057.631284:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000100:00100000:3.0:1789050057.631385:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:11336:x1875954691538304:12345-192.168.206.1@tcp:35:bash.0 Request processed in 456us (707us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789050057.631393:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000020:00080000:3.0:1789050057.631410:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050057.714658:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.714738:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691538560 00000100:00100000:2.0:1789050057.714748:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691538560 00000100:00100000:2.0:1789050057.714865:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 143 00000100:00100000:2.0:1789050057.714876:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+20:11346:x1875954691538560:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050057.714901:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050057.714922:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34f9fa expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050057.715006:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789050057.715149:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79430 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9fa expref: 22 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.715224:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:2.0:1789050057.715227:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050057.715232:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9fa expref: 22 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.715245:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050057.715306:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+21:11346:x1875954691538560:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 432us (656us total) trans 4294967424 rc 301/301 00000100:00100000:2.0:1789050057.715313:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 143 00000100:00100000:1.0:1789050057.720663:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050057.720751:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691538816 00000100:00100000:3.0:1789050057.720760:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691538816 00000100:00100000:3.0:1789050057.720811:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:3.0:1789050057.720820:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:11346:x1875954691538816:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050057.721097:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+22:11346:x1875954691538816:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 277us (443us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789050057.721106:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:3.0:1789050057.851643:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.854525:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691538944 00000100:00100000:1.0:1789050057.854540:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691538944 00000100:00100000:1.0:1789050057.854627:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 144 00000100:00100000:1.0:1789050057.854639:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+22:11352:x1875954691538944:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050057.854664:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050057.854684:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b7943e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa01 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854745:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854758:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854768:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050057.854799:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789050057.854816:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050057.854836:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854861:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b7943e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa01 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854880:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa01 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.854888:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050057.854891:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050057.854895:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f000, rc 0) 00000100:00100000:1.0:1789050057.854973:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+23:11352:x1875954691538944:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 336us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.854980:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 144 00010000:00010000:1.0:1789050057.867482:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050057.868893:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.869059:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539200 00000100:00100000:1.0:1789050057.869069:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539200 00000100:00100000:1.0:1789050057.869136:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 145 00000100:00100000:1.0:1789050057.869147:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:11352:x1875954691539200:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050057.869165:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050057.869189:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b7944c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa08 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.869787:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.869801:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.869824:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050057.869836:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789050057.869969:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b7944c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa08 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.869989:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa08 expref: 25 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.869998:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050057.870001:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050057.870004:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:1.0:1789050057.870126:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+25:11352:x1875954691539200:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 981us (1240us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1789050057.870134:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 145 00000100:00100000:0.0:1789050057.885973:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050057.886020:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.886171:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539584 00000100:00100000:1.0:1789050057.886191:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539584 00000100:00100000:1.0:1789050057.886273:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:1.0:1789050057.886285:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+25:2348:x1875954691539584:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050057.886300:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050057.886323:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa08 expref: 25 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.886345:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:1.0:1789050057.886350:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050057.886431:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+24:2348:x1875954691539584:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 132us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.886439:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050057.886660:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539456 00000100:00100000:2.0:1789050057.886665:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539456 00000100:00100000:2.0:1789050057.886706:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 146 00000100:00100000:2.0:1789050057.886725:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+24:11352:x1875954691539456:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050057.886745:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050057.886760:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa0f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.886846:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.886861:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.886871:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050057.886883:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789050057.887001:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa0f expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.887017:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa0f expref: 26 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.887024:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:2.0:1789050057.887027:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789050057.887029:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51e00, rc 0) 00000100:00100000:2.0:1789050057.887055:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11352:x1875954691539456:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 331us (1091us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789050057.887061:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 146 00000100:00100000:3.0:1789050057.896104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.896269:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539712 00000100:00100000:2.0:1789050057.896281:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539712 00000100:00100000:2.0:1789050057.896345:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:2.0:1789050057.896356:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691539712:12345-192.168.206.1@tcp:1:lfs.0 00010000:00010000:2.0:1789050057.896399:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.896437:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.896446:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050057.896451:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050057.896455:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.896491:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.896520:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 6 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050057.896541:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6671:1875954704125184:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050057.896882:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050057.901458:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.901577:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6671:1875954704125184:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050057.901623:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050057.904396:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539840 00000100:00100000:0.0:1789050057.904410:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539840 00002000:00100000:0.0:1789050057.904587:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff95073c258380 x1875954691539840/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:558/0 lens 504/0 e 0 to 0 dl 1789050068 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050057.904597:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c258380 with x1875954691539840 ext(0->12) 00010000:00010000:0.0:1789050057.904980:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.905012:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 7 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050057.905021:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95073c258380 00000100:00100000:0.0:1789050057.905062:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:0.0:1789050057.905073:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691539840:12345-192.168.206.1@tcp:4:lfs.0 00000100:00100000:0.0:1789050057.907966:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691539840:12345-192.168.206.1@tcp:4:lfs.0 Request processed in 2886us (6508us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789050057.907979:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00002000:00100000:0.0:1789050057.907991:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff95073c258380 x1875954691539840/t4294967305(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:558/0 lens 504/448 e 0 to 0 dl 1789050068 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050057.908001:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c258380 with x1875954691539840 ext(0->12) 00010000:00010000:0.0:1789050057.908011:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.908029:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050057.908037:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95073c258380 00000100:00100000:1.0:1789050057.911720:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050057.911806:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691539968 00000100:00100000:2.0:1789050057.911816:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691539968 00010000:00010000:2.0:1789050057.911854:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050057.911894:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:2.0:1789050057.911904:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691539968:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050057.911919:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789050057.911937:0:5801:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789050057.911940:0:5801:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789050058396937941 00002000:00010000:2.0:1789050057.911942:0:5801:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789050058663543342 00002000:00010000:2.0:1789050057.911944:0:5801:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789050058396937941 00010000:00010000:2.0:1789050057.911950:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.911983:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.912190:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db36fd7d/0x9df728c939b79429 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9f3 expref: 9 pid: 8215 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.912314:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050057.912319:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050057.912325:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.912335:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.912556:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050057.912629:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691539968:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 724us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.912637:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 62 00010000:00010000:0.0:1789050057.914341:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.914358:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914502:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914512:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914520:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914534:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050057.914538:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914547:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914564:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.914573:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050057.914717:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691539712:12345-192.168.206.1@tcp:1:lfs.0 Request processed in 18359us (18616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.914726:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:1.0:1789050057.918307:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050057.918465:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691540224 00000100:00100000:3.0:1789050057.918475:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691540224 00000100:00100000:3.0:1789050057.918527:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:3.0:1789050057.918537:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:11352:x1875954691540224:12345-192.168.206.1@tcp:35:lfs.0 00000004:00010000:3.0:1789050057.918593:0:5821:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa0f expref: 26 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050057.918892:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789050057.918950:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1789050057.919839:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789050057.920186:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.920236:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 30 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.920245:0:5821:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.920300:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 30 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.920315:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 30 pid: 5819 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050057.920329:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875954704125312:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050057.920417:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507205ef9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050057.923132:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875954704125312:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050057.923159:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050057.925598:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050057.925819:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691540352 00000100:00100000:0.0:1789050057.925829:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691540352 00010000:00010000:0.0:1789050057.925868:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 31 pid: 5819 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050057.925907:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:0.0:1789050057.925917:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+31:2348:x1875954691540352:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050057.925931:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050057.925938:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 31 pid: 5819 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.925950:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 31 pid: 5819 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.925970:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9e5 expref: 31 pid: 5819 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.925988:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:0.0:1789050057.925994:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.927273:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050057.927293:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050057.927591:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050057.927700:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+30:2348:x1875954691540352:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 1780us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.927710:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00010000:00010000:3.0:1789050057.927803:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.927811:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050057.927935:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000001:00080000:3.0:1789050057.928137:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00000100:00100000:3.0:1789050057.928282:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704125440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789050057.928335:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050057.928373:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507205efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050057.928544:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125440 00000100:00100000:2.0:1789050057.928552:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125440 00000100:00100000:2.0:1789050057.928621:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050057.928631:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1875954704125440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050057.928703:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1875954704125440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050057.928733:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789050057.928972:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050057.929003:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704125440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789050057.929721:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00000100:00100000:3.0:1789050057.929783:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704125568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789050057.929827:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050057.929858:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507205ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050057.930242:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704125568 00000100:00100000:2.0:1789050057.930250:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704125568 00000100:00100000:2.0:1789050057.930282:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050057.930289:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1875954704125568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050057.930459:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1875954704125568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (631us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789050057.930466:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050057.931411:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704125568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789050057.931487:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967434 00010000:00010000:3.0:1789050057.931533:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931544:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931552:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931558:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050057.931562:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931570:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931584:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:3.0:1789050057.931587:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789050057.931592:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050057.931598:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7947d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050057.931810:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789050057.932542:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789050057.932557:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293920356871ns, next at 294920353872ns, rc = 0 00000001:00080000:3.0:1789050057.932578:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00010000:00010000:3.0:1789050057.932701:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4000) 00010000:00010000:3.0:1789050057.932705:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789050057.932713:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79468 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa0f expref: 34 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050057.932817:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+33:11352:x1875954691540224:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 14281us (14518us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789050057.932827:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00000020:00080000:3.0:1789050057.932833:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789050057.938364:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050057.938451:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691540480 00000100:00100000:1.0:1789050057.938461:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691540480 00000100:00100000:1.0:1789050057.938520:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 147 00000100:00100000:1.0:1789050057.938530:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+33:11352:x1875954691540480:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050057.938552:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050057.938572:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa16 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.938640:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa16 expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.938653:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa16 expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050057.938669:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050057.938672:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050057.938675:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f600, rc 0) 00000100:00100000:1.0:1789050057.938732:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+34:11352:x1875954691540480:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 204us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050057.938738:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 147 00000100:00100000:2.0:1789050057.943385:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050057.943473:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691540736 00000100:00100000:0.0:1789050057.943482:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691540736 00000100:00100000:0.0:1789050057.943530:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:0.0:1789050057.943540:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+34:11352:x1875954691540736:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050057.943754:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+35:11352:x1875954691540736:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 215us (377us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789050057.943762:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:0.0:1789050058.030193:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.030376:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691540992 00000100:00100000:2.0:1789050058.030387:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691540992 00000100:00100000:2.0:1789050058.030439:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 148 00000100:00100000:2.0:1789050058.030449:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+35:11362:x1875954691540992:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050058.030471:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050058.030490:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7948b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa1d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050058.030572:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789050058.030707:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7948b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa1d expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.030721:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:2.0:1789050058.030724:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050058.030729:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7948b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa1d expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.030742:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:2.0:1789050058.030814:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:11362:x1875954691540992:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 367us (641us total) trans 4294967438 rc 301/301 00000100:00100000:2.0:1789050058.030821:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 148 00000100:00100000:2.0:1789050058.035131:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050058.035238:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691541120 00000100:00100000:1.0:1789050058.035248:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691541120 00000100:00100000:1.0:1789050058.035311:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 149 00000100:00100000:1.0:1789050058.035321:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+36:11362:x1875954691541120:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:1.0:1789050058.035392:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035407:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035420:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035436:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035443:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035449:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035533:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035541:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035548:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050058.035584:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035595:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035621:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035627:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035633:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050058.035637:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035644:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035655:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050058.035658:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050058.035663:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035669:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035697:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035704:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035709:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035714:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050058.035722:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035729:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035736:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4a00) 00010000:00010000:1.0:1789050058.035738:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050058.035741:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035747:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035765:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035771:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035777:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035782:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050058.035785:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035790:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035796:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050058.035798:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050058.035805:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.035811:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050058.035878:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+36:11362:x1875954691541120:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 558us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050058.035886:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 149 00000100:00100000:3.0:1789050058.039169:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050058.039318:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691541376 00000100:00100000:0.0:1789050058.039327:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691541376 00000100:00100000:0.0:1789050058.039377:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:0.0:1789050058.039386:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+36:11362:x1875954691541376:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050058.039586:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+37:11362:x1875954691541376:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 200us (426us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789050058.039593:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:0.0:1789050058.078279:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.078421:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691541632 00000100:00100000:2.0:1789050058.078432:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691541632 00000100:00100000:2.0:1789050058.078481:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 150 00000100:00100000:2.0:1789050058.078491:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+37:11365:x1875954691541632:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050058.078516:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050058.078533:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b794ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa24 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078598:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078624:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078636:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078648:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078655:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078661:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078762:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078785:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078793:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050058.078804:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789050058.078887:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078895:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078914:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078920:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050058.078924:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078931:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078942:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050058.078945:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050058.078949:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078955:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078966:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078977:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078983:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078988:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050058.078991:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.078997:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.079004:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95072c9b1700) 00010000:00010000:2.0:1789050058.079007:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050058.079010:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.079015:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.079051:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b794ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.079064:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.079071:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050058.079073:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050058.079081:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:2.0:1789050058.079141:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+39:11365:x1875954691541632:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 651us (870us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789050058.079149:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 150 00000100:00100000:2.0:1789050058.082531:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050058.082619:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691541760 00000100:00100000:1.0:1789050058.082628:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691541760 00000100:00100000:1.0:1789050058.082686:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 151 00000100:00100000:1.0:1789050058.082696:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+39:11365:x1875954691541760:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:1.0:1789050058.082752:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082767:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082779:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082801:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082808:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082814:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082819:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050058.082838:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082845:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082857:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050058.082860:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050058.082865:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.082872:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050058.082957:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+39:11365:x1875954691541760:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 262us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050058.082964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 151 00000100:00100000:2.0:1789050058.086688:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050058.086774:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691542016 00000100:00100000:0.0:1789050058.086784:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691542016 00000100:00100000:0.0:1789050058.086836:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:0.0:1789050058.086846:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+39:11365:x1875954691542016:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050058.087072:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+40:11365:x1875954691542016:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 227us (393us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789050058.087080:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:0.0:1789050058.325284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.325383:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691542272 00000100:00100000:2.0:1789050058.325393:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691542272 00000100:00100000:2.0:1789050058.325453:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 152 00000100:00100000:2.0:1789050058.325465:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+40:11396:x1875954691542272:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:2.0:1789050058.325490:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050058.325512:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa2b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.325634:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.325649:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.325672:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050058.325684:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789050058.325811:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b794d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa2b expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.325830:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa2b expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.325857:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050058.325861:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050058.325864:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050058.326304:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+42:11396:x1875954691542272:12345-192.168.206.1@tcp:101:cat.0 Request processed in 840us (1027us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789050058.326313:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 152 00000100:00100000:2.0:1789050058.340236:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.340278:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050058.340423:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691542400 00000100:00100000:3.0:1789050058.340433:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691542400 00000100:00100000:3.0:1789050058.340501:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:3.0:1789050058.340511:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+42:2348:x1875954691542400:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050058.340526:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050058.340548:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b794df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa2b expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.340566:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:3.0:1789050058.340572:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050058.340634:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+41:2348:x1875954691542400:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050058.340642:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:0.0:1789050058.340681:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691542656 00000100:00100000:0.0:1789050058.340686:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691542656 00000100:00100000:0.0:1789050058.340726:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:0.0:1789050058.340734:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+41:11396:x1875954691542656:12345-192.168.206.1@tcp:35:cat.0 00000100:00100000:0.0:1789050058.340957:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+42:11396:x1875954691542656:12345-192.168.206.1@tcp:35:cat.0 Request processed in 223us (778us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789050058.340965:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:3.0:1789050058.442357:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050058.442551:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691542912 00000100:00100000:1.0:1789050058.442562:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691542912 00000100:00100000:1.0:1789050058.442643:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 153 00000100:00100000:1.0:1789050058.442654:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+42:11402:x1875954691542912:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:1.0:1789050058.442681:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050058.442683:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789050058.442710:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa01 expref: 42 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442730:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050058.442735:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050058.442747:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa32 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442853:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442866:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442875:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442919:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.442933:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 42 pid: 5817 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050058.442946:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704125696:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050058.443038:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507207d4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050058.446775:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050058.447099:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704125696:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050058.447127:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050058.447441:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691543040 00000100:00100000:3.0:1789050058.447449:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691543040 00010000:00010000:3.0:1789050058.447482:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 43 pid: 5817 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050058.447533:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050058.447544:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+43:2347:x1875954691543040:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050058.447558:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050058.447565:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 43 pid: 5817 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447576:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 43 pid: 5817 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447616:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b794c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa24 expref: 43 pid: 5817 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447632:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:3.0:1789050058.447637:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447645:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447652:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.447678:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050058.447740:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+42:2347:x1875954691543040:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 197us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050058.447748:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00010000:00010000:1.0:1789050058.447807:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.447815:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050058.447834:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789050058.447995:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b794ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.448012:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 42 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.448019:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050058.448022:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789050058.448024:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:1.0:1789050058.448050:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+42:11402:x1875954691542912:12345-192.168.206.1@tcp:101:dd.0 Request processed in 5398us (5704us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789050058.448057:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 153 00000100:00100000:0.0:1789050058.452438:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.452641:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691543296 00000100:00100000:2.0:1789050058.452651:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691543296 00000100:00100000:2.0:1789050058.452700:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 154 00000100:00100000:2.0:1789050058.452709:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+42:11402:x1875954691543296:12345-192.168.206.1@tcp:36:dd.0 00010000:00010000:2.0:1789050058.453363:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.454846:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.454868:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050058.454971:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789050058.455022:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000001a3d4044 reply state 00000000bd148a6a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050058.455032:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050058.455326:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+45:11402:x1875954691543296:12345-192.168.206.1@tcp:36:dd.0 Request processed in 2614us (2893us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789050058.455334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 154 00000020:00080000:2.0:1789050058.455340:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050058.460073:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460090:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460097:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460103:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050058.460107:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460115:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460132:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050058.460136:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050058.460141:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.460146:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79502 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050058.813227:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.815160:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691543424 00000100:00100000:2.0:1789050058.815179:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691543424 00000100:00100000:2.0:1789050058.815293:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 155 00000100:00100000:2.0:1789050058.815305:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+44:11416:x1875954691543424:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:2.0:1789050058.815341:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050058.815360:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa39 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815421:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815436:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815447:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815460:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815467:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815473:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815554:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815565:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815573:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815620:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.815640:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 45 pid: 5818 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050058.815654:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704125824:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050058.815748:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050058.819792:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704125824:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050058.819820:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050058.822155:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050058.822512:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691543680 00000100:00100000:3.0:1789050058.822533:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691543680 00000100:00100000:3.0:1789050058.822589:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:3.0:1789050058.822609:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+46:5588:x1875954691543680:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789050058.822908:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+47:5588:x1875954691543680:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 309us (760us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789050058.822916:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:0.0:1789050058.834034:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050058.834113:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691543808 00000100:00100000:1.0:1789050058.834123:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691543808 00010000:00010000:1.0:1789050058.834166:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 47 pid: 5818 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050058.834230:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:1.0:1789050058.834241:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+47:2348:x1875954691543808:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050058.834256:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050058.834263:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 47 pid: 5818 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834276:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 47 pid: 5818 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834297:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b794f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa32 expref: 47 pid: 5818 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834333:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050058.834339:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834348:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834356:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050058.834390:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050058.834445:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+46:2348:x1875954691543808:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 206us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050058.834452:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00010000:00010000:2.0:1789050058.835810:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.835825:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050058.835870:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789050058.835874:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050058.836027:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836043:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836052:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836058:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836083:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836088:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050058.836092:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836099:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836111:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050058.836114:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050058.836118:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836124:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79510 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836138:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836144:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836149:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836154:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050058.836157:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836327:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836337:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95072c9b1700) 00010000:00010000:2.0:1789050058.836339:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050058.836342:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836347:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836384:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa39 expref: 46 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836397:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa39 expref: 45 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.836404:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050058.836406:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050058.836409:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050058.836945:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+45:11416:x1875954691543424:12345-192.168.206.1@tcp:101:stat.0 Request processed in 21633us (23741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050058.836956:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 155 00010000:00010000:2.0:1789050058.891541:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050058.923175:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050058.923295:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691544064 00000100:00100000:2.0:1789050058.923305:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691544064 00000100:00100000:2.0:1789050058.923361:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 156 00000100:00100000:2.0:1789050058.923372:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+45:11422:x1875954691544064:12345-192.168.206.1@tcp:36:truncate.0 00010000:00010000:2.0:1789050058.923454:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050058.923481:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7951e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa39 expref: 45 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.923501:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050058.923507:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050058.923716:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.923730:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050058.923740:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050058.923789:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789050058.923814:0:5819:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000002ecb24e3 reply state 00000000a4cf0203 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050058.923823:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050058.923913:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+47:11422:x1875954691544064:12345-192.168.206.1@tcp:36:truncate.0 Request processed in 542us (756us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789050058.923920:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 156 00000020:00080000:2.0:1789050058.923925:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789050058.927633:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927650:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927658:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927664:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050058.927668:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927676:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927691:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:3.0:1789050058.927694:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050058.927699:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050058.927717:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79525 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050058.996416:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789050058.996435:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1789050059.071122:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.071296:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691544192 00000100:00100000:1.0:1789050059.071306:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691544192 00000100:00100000:1.0:1789050059.071379:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 157 00000100:00100000:1.0:1789050059.071392:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+46:11436:x1875954691544192:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:1.0:1789050059.071414:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.071434:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7952c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa40 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071496:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071509:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071534:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071548:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071554:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071561:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071662:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071671:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071678:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050059.071859:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789050059.071864:0:5818:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050059.071897:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071909:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071917:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071935:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071942:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071948:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.071953:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071962:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071975:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050059.071978:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.071983:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.071989:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b79533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072005:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072011:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072017:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072022:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.072032:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072039:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072048:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.072051:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.072054:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072059:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b7953a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072095:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b7952c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 48 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072109:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.072116:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.072119:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050059.072121:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e600, rc 0) 00000100:00100000:1.0:1789050059.072192:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+47:11436:x1875954691544192:12345-192.168.206.1@tcp:101:stat.0 Request processed in 802us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.072247:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 157 00000100:00080000:3.0:1789050059.073319:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050059.188440:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.188563:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691544448 00000100:00100000:2.0:1789050059.188572:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691544448 00000100:00100000:2.0:1789050059.188674:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 158 00000100:00100000:2.0:1789050059.188695:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+47:11446:x1875954691544448:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050059.189467:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050059.189501:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa47 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050059.189580:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789050059.191526:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79548 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa47 expref: 49 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.191547:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:2.0:1789050059.191550:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050059.191556:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa47 expref: 49 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.191579:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050059.191670:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+48:11446:x1875954691544448:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2986us (3238us total) trans 4294967450 rc 301/301 00000100:00100000:2.0:1789050059.192127:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 158 00000100:00100000:0.0:1789050059.195104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.195833:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691544704 00000100:00100000:2.0:1789050059.195843:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691544704 00000100:00100000:2.0:1789050059.195896:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:2.0:1789050059.195905:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+48:11446:x1875954691544704:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050059.196117:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+49:11446:x1875954691544704:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 212us (1022us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789050059.196125:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:3.0:1789050059.257066:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.257181:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691544960 00000100:00100000:1.0:1789050059.257190:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691544960 00000100:00100000:1.0:1789050059.257273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 159 00000100:00100000:1.0:1789050059.257298:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+49:11452:x1875954691544960:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050059.257325:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.257353:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79556 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.257456:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.257469:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 50 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.257477:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.257516:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 50 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.257529:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 50 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.257542:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704125952:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050059.257634:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507207d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050059.263369:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704125952:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050059.263399:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.263750:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.266238:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691545088 00000100:00100000:2.0:1789050059.266254:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691545088 00010000:00010000:2.0:1789050059.266304:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 51 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050059.266367:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:2.0:1789050059.266378:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+51:2348:x1875954691545088:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050059.266393:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050059.266400:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 51 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266412:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 51 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266433:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa40 expref: 51 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266455:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050059.266461:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266470:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266477:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.266563:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050059.266643:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:2348:x1875954691545088:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 266us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050059.266652:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 66 00010000:00010000:0.0:1789050059.266698:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.266717:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050059.266736:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789050059.267954:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79556 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 51 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.267980:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 50 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.268001:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:0.0:1789050059.268005:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789050059.268008:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:0.0:1789050059.268062:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+50:11452:x1875954691544960:12345-192.168.206.1@tcp:101:bash.0 Request processed in 10765us (11004us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789050059.268070:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 159 00000100:00100000:3.0:1789050059.274339:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.274409:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691545344 00000100:00100000:2.0:1789050059.274487:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691545344 00000100:00100000:2.0:1789050059.274632:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 160 00000100:00100000:2.0:1789050059.274643:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:11452:x1875954691545344:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:2.0:1789050059.275154:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.275172:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.275183:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050059.275272:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967453 00000004:00010000:2.0:1789050059.275301:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b449ed37 reply state 000000004e026694 transno 4294967454 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050059.275309:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050059.275394:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+53:11452:x1875954691545344:12345-192.168.206.1@tcp:36:bash.0 Request processed in 752us (1072us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789050059.275401:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 160 00000020:00080000:2.0:1789050059.275406:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050059.278267:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278283:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278290:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278296:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050059.278300:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278317:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278332:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050059.278336:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050059.278341:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.278347:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7956b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.282310:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.282526:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691545472 00000100:00100000:2.0:1789050059.282536:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691545472 00000100:00100000:2.0:1789050059.282583:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 161 00000100:00100000:2.0:1789050059.282604:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+52:11452:x1875954691545472:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050059.282628:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050059.282647:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79572 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa55 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.282737:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.282751:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.282760:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.282792:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.282817:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 53 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050059.282829:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c17f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704126080:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050059.282919:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1789050059.285699:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.286253:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691545600 00000100:00100000:1.0:1789050059.286261:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691545600 00010000:00010000:1.0:1789050059.286297:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 54 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.286337:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:1.0:1789050059.286347:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:2348:x1875954691545600:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050059.286373:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050059.286380:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 54 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.286392:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 54 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.286414:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.286419:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.286620:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.286628:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.286648:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050059.286829:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:2348:x1875954691545600:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 483us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.286836:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 67 00010000:00010000:2.0:1789050059.289078:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05ec00/0x9df728c939b7955d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa4e expref: 53 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050059.289104:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c17f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704126080:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050059.289129:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.289139:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.289146:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050059.289187:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789050059.289191:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050059.289314:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.289358:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79572 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa55 expref: 53 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.289373:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa55 expref: 52 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.289396:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:2.0:1789050059.289399:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050059.289402:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050059.289461:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+52:11452:x1875954691545472:12345-192.168.206.1@tcp:101:bash.0 Request processed in 6869us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050059.289469:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 161 00000100:00100000:3.0:1789050059.295426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.295605:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691545856 00000100:00100000:0.0:1789050059.295614:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691545856 00000100:00100000:0.0:1789050059.295671:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:0.0:1789050059.295682:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+52:11452:x1875954691545856:12345-192.168.206.1@tcp:35:bash.0 00000100:00100000:0.0:1789050059.295883:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+53:11452:x1875954691545856:12345-192.168.206.1@tcp:35:bash.0 Request processed in 203us (466us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789050059.295891:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:1.0:1789050059.382939:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.383046:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691546112 00000100:00100000:2.0:1789050059.383056:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691546112 00000100:00100000:2.0:1789050059.383111:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 162 00000100:00100000:2.0:1789050059.383122:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+53:11462:x1875954691546112:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050059.383145:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050059.383165:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa5c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050059.383281:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789050059.383695:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79580 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa5c expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.383710:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:2.0:1789050059.383713:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050059.383719:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b79580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa5c expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.383733:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51e00, rc 0) 00000100:00100000:2.0:1789050059.383829:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:11462:x1875954691546112:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 707us (898us total) trans 4294967456 rc 301/301 00000100:00100000:2.0:1789050059.383851:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 162 00000100:00100000:0.0:1789050059.389718:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.389877:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691546240 00000100:00100000:1.0:1789050059.389887:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691546240 00000100:00100000:1.0:1789050059.389961:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 163 00000100:00100000:1.0:1789050059.389971:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+54:11462:x1875954691546240:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:1.0:1789050059.390331:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390365:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390376:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390391:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390398:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390404:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390502:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390512:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390519:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050059.390556:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390568:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390575:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390591:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390608:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.390612:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390620:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390631:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050059.390635:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.390639:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390646:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0f800/0x9df728c939b7958e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390661:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390666:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390672:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390676:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0ee00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.390678:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390693:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390700:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.390702:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.390705:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390710:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073bc0ee00/0x9df728c939b79595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390726:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390731:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390736:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390740:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.390743:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390748:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390754:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.390757:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.390759:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.390772:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7959c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.390845:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+54:11462:x1875954691546240:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 875us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.390853:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 163 00000100:00100000:0.0:1789050059.399048:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.399178:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691546496 00000100:00100000:2.0:1789050059.399187:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691546496 00000100:00100000:2.0:1789050059.399269:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:2.0:1789050059.399279:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+54:11462:x1875954691546496:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050059.399488:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+55:11462:x1875954691546496:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 210us (458us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789050059.399495:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:2.0:1789050059.405469:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704126208:0@lo:400:kworker.0 00000100:00100000:2.0:1789050059.405535:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050059.405610:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704126720:0@lo:400:kworker.0 00000100:00100000:2.0:1789050059.405636:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050059.405662:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789050059.405668:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073caff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704126336:0@lo:400:kworker.0 00000100:00100000:2.0:1789050059.405689:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050059.405706:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704126848:0@lo:400:kworker.0 00000100:00100000:2.0:1789050059.405728:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.406274:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704126464:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406304:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.406325:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050059.406331:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704126592:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406351:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.406379:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126848 00000100:00100000:0.0:1789050059.406386:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126848 00000100:00100000:0.0:1789050059.406424:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126592 00000100:00100000:0.0:1789050059.406427:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126592 00000100:00100000:0.0:1789050059.406449:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050059.406463:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704126848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406511:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704126848:12345-0@lo:400:kworker.0 Request processed in 49us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.406517:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789050059.406532:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789050059.406537:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704126592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406563:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704126592:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.406568:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789050059.406604:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050059.406607:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050059.406631:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704126592:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406653:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789050059.406657:0:3284:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789050059.406671:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704126848:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406686:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126720 00000100:00100000:0.0:1789050059.406689:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126720 00000100:00100000:0.0:1789050059.406717:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126336 00000100:00100000:0.0:1789050059.406720:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126336 00000100:00100000:0.0:1789050059.406731:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126464 00000100:00100000:0.0:1789050059.406734:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126464 00000100:00100000:0.0:1789050059.406747:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789050059.406752:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704126720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406787:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704126720:12345-0@lo:400:kworker.0 Request processed in 35us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.406794:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789050059.406805:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789050059.406817:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704126336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406844:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704126336:12345-0@lo:400:kworker.0 Request processed in 28us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.406849:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789050059.406859:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789050059.406865:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704126464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.406894:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704126464:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.408145:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126208 00000100:00100000:1.0:1789050059.408154:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126208 00000100:00100000:1.0:1789050059.408224:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789050059.408233:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704126208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.408285:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704126208:12345-0@lo:400:kworker.0 Request processed in 54us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.408291:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1789050059.408338:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050059.408379:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073caff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704126336:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.408389:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704126208:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.408399:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704126720:0@lo:400:kworker.0 00000100:00100000:1.0:1789050059.408439:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704126464:0@lo:400:kworker.0 00000100:00100000:0.0:1789050059.409149:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789050059.452338:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.452440:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691546752 00000100:00100000:1.0:1789050059.452449:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691546752 00000100:00100000:1.0:1789050059.452501:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 164 00000100:00100000:1.0:1789050059.452510:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+55:11465:x1875954691546752:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050059.452533:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.452551:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b795a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa63 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452638:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452650:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452660:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452673:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452679:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452686:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452966:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b795b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452976:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b795b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.452983:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b795b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050059.452992:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789050059.453112:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453119:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453133:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453140:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.453144:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453151:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453162:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050059.453416:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.453422:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453430:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b795aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453444:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453450:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453455:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453460:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050059.453463:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453478:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453486:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.453488:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050059.453491:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453497:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453534:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b795a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa63 expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453546:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b795b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa63 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.453553:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.453555:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050059.453557:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531e00, rc 0) 00000100:00100000:1.0:1789050059.453621:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+57:11465:x1875954691546752:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1111us (1291us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789050059.453628:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 164 00000100:00100000:2.0:1789050059.458978:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.459056:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691546880 00000100:00100000:3.0:1789050059.459065:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691546880 00000100:00100000:3.0:1789050059.459117:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 165 00000100:00100000:3.0:1789050059.459127:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:11465:x1875954691546880:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:3.0:1789050059.459221:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459237:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459249:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459273:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459281:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459287:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459305:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050059.459310:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459317:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:3.0:1789050059.459332:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050059.459337:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.459343:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.459406:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:11465:x1875954691546880:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 281us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.459414:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 165 00000100:00100000:2.0:1789050059.459996:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.460055:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691547008 00000100:00100000:3.0:1789050059.460061:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691547008 00000100:00100000:3.0:1789050059.460103:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050059.460112:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:2347:x1875954691547008:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050059.460124:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050059.460141:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b795b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa63 expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.460156:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:3.0:1789050059.460160:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050059.460277:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736c96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:2347:x1875954691547008:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 165us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.460284:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:1.0:1789050059.462089:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.462150:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691547264 00000100:00100000:3.0:1789050059.462157:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691547264 00000100:00100000:3.0:1789050059.462217:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:3.0:1789050059.462227:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:11465:x1875954691547264:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050059.462485:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:11465:x1875954691547264:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 258us (402us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789050059.462492:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000001:00080000:0.0:1789050059.465389:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:0.0:1789050059.465419:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:0.0:1789050059.465448:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789050059.465472:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff950704e98f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789050059.465477:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c8d6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950704e98840 00000020:00080000:0.0:1789050059.465480:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c8d6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95072070e000 00000020:00080000:0.0:1789050059.465510:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789050059.465685:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789050059.465881:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050059.466019:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704126976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789050059.466071:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050059.466110:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704126976 00000100:00100000:3.0:1789050059.466117:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704126976 00000100:00100000:3.0:1789050059.466153:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050059.466160:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704126976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789050059.466190:0:8215:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1789050059.466233:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb8ca0242ed5, atime: 0x18d3fb8cb008422e, ctime: 0x18d3fb8ca0242ed5, blocks: 0xb 00010000:00010000:3.0:1789050059.466242:0:8215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.466257:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789050059.466261:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050059.466266:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.466296:0:8215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.466305:0:8215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.466313:0:8215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.466326:0:8215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789050059.466845:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704126976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 684us (772us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789050059.466853:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:3.0:1789050059.467024:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c272680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789050059.467031:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704126976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789050059.467246:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050059.467253:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.467262:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050059.467267:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.467285:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.467302:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.467308:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041740d10/0x9df728c939b795cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.467326:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050059.467328:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050059.467330:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050059.627636:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.627799:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691547520 00000100:00100000:1.0:1789050059.627809:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691547520 00000100:00100000:1.0:1789050059.627968:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 166 00000100:00100000:1.0:1789050059.627980:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+18:11483:x1875954691547520:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:1.0:1789050059.628015:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.628035:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b795d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.628139:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.628152:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.628163:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050059.628186:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789050059.628345:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b795d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa6a expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.628364:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa6a expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.628372:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.628375:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789050059.628378:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530600, rc 0) 00000100:00100000:1.0:1789050059.628478:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:11483:x1875954691547520:12345-192.168.206.1@tcp:101:cat.0 Request processed in 500us (849us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789050059.628485:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 166 00000100:00100000:0.0:1789050059.650152:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.650269:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691547648 00000100:00100000:3.0:1789050059.650279:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691547648 00000100:00100000:3.0:1789050059.650336:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 167 00000100:00100000:3.0:1789050059.650345:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:11484:x1875954691547648:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050059.650368:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050059.650387:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa71 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650449:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650476:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650487:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050059.650522:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789050059.650526:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050059.650542:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650566:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa71 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650586:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa71 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.650605:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050059.650608:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050059.650611:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06800, rc 0) 00000100:00100000:3.0:1789050059.650672:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:11484:x1875954691547648:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 328us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.650688:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 167 00000100:00100000:3.0:1789050059.656101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050059.656197:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548032 00000100:00100000:2.0:1789050059.656222:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548032 00000100:00100000:2.0:1789050059.656278:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:2.0:1789050059.656287:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:11484:x1875954691548032:12345-192.168.206.1@tcp:35:lfs.0 00000001:00080000:2.0:1789050059.656530:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967461 00000100:00100000:2.0:1789050059.656645:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:11484:x1875954691548032:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 358us (552us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789050059.656653:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000020:00080000:2.0:1789050059.656658:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050059.661620:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.661863:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548160 00000100:00100000:1.0:1789050059.661871:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548160 00000100:00100000:1.0:1789050059.662034:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:1.0:1789050059.662059:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+23:11484:x1875954691548160:12345-192.168.206.1@tcp:103:lfs.0 00010000:00010000:1.0:1789050059.662075:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789050059.662096:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa55 expref: 23 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.662116:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b795db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa6a expref: 22 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.662130:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa16 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.662141:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.662152:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050059.662257:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:11484:x1875954691548160:12345-192.168.206.1@tcp:103:lfs.0 Request processed in 201us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.662264:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050059.664602:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.664783:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548288 00000100:00100000:3.0:1789050059.664792:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548288 00000100:00100000:3.0:1789050059.664845:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 168 00000100:00100000:3.0:1789050059.664855:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:11484:x1875954691548288:12345-192.168.206.1@tcp:58:lfs.0 00010000:00010000:3.0:1789050059.664967:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.664983:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.664994:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050059.665462:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789050059.665642:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:11484:x1875954691548288:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 787us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.665651:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 168 00000100:00100000:2.0:1789050059.684315:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.684414:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548416 00000100:00100000:3.0:1789050059.684424:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548416 00000100:00100000:3.0:1789050059.684481:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 169 00000100:00100000:3.0:1789050059.684492:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:11486:x1875954691548416:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050059.684520:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050059.684540:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b795fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa78 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684613:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684626:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684638:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684668:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684675:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.684681:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685022:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685032:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685039:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050059.685282:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789050059.685287:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050059.685306:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685318:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685325:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685331:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685347:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685352:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050059.685356:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685362:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685373:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050059.685376:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050059.685380:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685385:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b79605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685396:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685401:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685407:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685412:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050059.685414:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685428:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685436:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dcf00) 00010000:00010000:3.0:1789050059.685438:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050059.685441:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685446:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7960c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685477:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b795fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685489:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.685584:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:3.0:1789050059.685586:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050059.685588:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07000, rc 0) 00000100:00100000:3.0:1789050059.685657:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:11486:x1875954691548416:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1166us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.685664:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 169 00000040:00080000:3.0:1789050059.723456:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050059.723466:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050059.723520:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789050059.723529:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050059.723669:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704127104:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789050059.723787:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050059.741028:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704127104:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050059.741345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.741426:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548544 00000100:00100000:1.0:1789050059.741434:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548544 00000100:00100000:1.0:1789050059.741482:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 170 00000100:00100000:1.0:1789050059.741491:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:11493:x1875954691548544:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050059.741519:0:5818:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050059.741625:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:11493:x1875954691548544:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 133us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.741633:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 170 00000100:00100000:2.0:1789050059.746274:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.746378:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548672 00000100:00100000:0.0:1789050059.746388:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548672 00000100:00100000:0.0:1789050059.746440:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 171 00000100:00100000:0.0:1789050059.746449:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+21:11493:x1875954691548672:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.746528:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746543:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746554:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746568:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746574:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746580:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746616:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746623:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746628:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050059.746661:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789050059.746666:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050059.746677:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746686:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746698:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746704:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746710:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.746714:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746722:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746733:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:0.0:1789050059.746736:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050059.746741:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746748:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7961a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746760:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746777:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746783:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746789:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.746797:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746805:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746812:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff950714b52200) 00010000:00010000:0.0:1789050059.746815:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050059.746817:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746822:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79621 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746836:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746842:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746848:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746853:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.746855:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746861:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746869:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:0.0:1789050059.746871:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050059.746880:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.746886:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b79628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.746958:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+21:11493:x1875954691548672:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 509us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.746966:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 171 00000100:00100000:0.0:1789050059.750028:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.750094:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691548928 00000100:00100000:3.0:1789050059.750103:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691548928 00000100:00100000:3.0:1789050059.750160:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 172 00000100:00100000:3.0:1789050059.750183:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:11493:x1875954691548928:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050059.750246:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050059.750265:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7962f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa7f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750354:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750369:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750380:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050059.750393:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789050059.750481:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750490:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750497:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750503:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050059.750518:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750527:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750540:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:3.0:1789050059.750543:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050059.750547:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750554:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750604:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7962f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa7f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750614:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:3.0:1789050059.750616:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050059.750620:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7962f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa7f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.750630:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07800, rc 0) 00000100:00100000:3.0:1789050059.750685:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691548928:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 516us (665us total) trans 4294967463 rc 301/301 00000100:00100000:3.0:1789050059.750692:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 172 00000100:00100000:2.0:1789050059.757804:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.758067:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691549056 00000100:00100000:0.0:1789050059.758076:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691549056 00000100:00100000:0.0:1789050059.758138:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 173 00000100:00100000:0.0:1789050059.758149:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691549056:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050059.758193:0:8158:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050059.758331:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691549056:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 183us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.758339:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 173 00000100:00100000:2.0:1789050059.767382:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.767502:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691549312 00000100:00100000:1.0:1789050059.767511:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691549312 00000100:00100000:1.0:1789050059.767574:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 174 00000100:00100000:1.0:1789050059.767585:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691549312:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050059.767615:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.767618:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789050059.767648:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b795f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa71 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.767667:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050059.767671:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050059.767683:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79644 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa86 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789050059.768386:0:5818:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789050059.768622:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7964b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.768637:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7964b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.768648:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7964b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.768700:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79644 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa86 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.768718:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7964b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa86 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.768725:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4500) 00010000:00010000:1.0:1789050059.768734:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050059.768737:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530000, rc 0) 00000100:00100000:1.0:1789050059.768804:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:11493:x1875954691549312:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1220us (1430us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1789050059.768812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 174 00000100:00100000:2.0:1789050059.788076:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.788911:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691549568 00000100:00100000:0.0:1789050059.788922:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691549568 00000100:00100000:0.0:1789050059.788984:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 175 00000100:00100000:0.0:1789050059.788994:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+23:11493:x1875954691549568:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.789048:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050059.789075:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b7964b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa86 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789097:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4500) 00010000:00010000:0.0:1789050059.789110:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050059.789148:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789162:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789520:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789535:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789541:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789547:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789757:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789770:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789776:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789782:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.789787:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789794:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789814:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050059.789816:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050059.789820:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789827:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79659 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789837:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789843:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789849:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789854:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.789857:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789862:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789869:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc1b9f08d (ffff950714b52200) 00010000:00010000:0.0:1789050059.789871:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050059.789874:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.789879:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc1b9f08d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.789983:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691549568:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 990us (1916us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050059.789991:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 175 00000100:00100000:0.0:1789050059.798979:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.799073:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691549696 00000100:00100000:1.0:1789050059.799083:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691549696 00000100:00100000:1.0:1789050059.799140:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 176 00000100:00100000:1.0:1789050059.799151:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691549696:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050059.799168:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050059.799189:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa8d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799262:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799276:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799287:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799392:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799410:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.799418:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.799427:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050059.799432:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530400, rc 0) 00000100:00100000:1.0:1789050059.799493:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:11493:x1875954691549696:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.799500:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 176 00000100:00100000:2.0:1789050059.808640:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.808718:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691549952 00000100:00100000:3.0:1789050059.808726:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691549952 00000100:00100000:3.0:1789050059.808791:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 177 00000100:00100000:3.0:1789050059.808801:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:11493:x1875954691549952:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050059.808881:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.808906:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.808918:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050059.809190:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789050059.809218:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295797017396ns, next at 296797014882ns, rc = 0 00000004:00010000:3.0:1789050059.809308:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000003856561 reply state 000000003deb8f7b transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.809317:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050059.809407:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+25:11493:x1875954691549952:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 606us (776us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1789050059.809414:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 177 00010000:00010000:3.0:1789050059.812703:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812719:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812736:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812748:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050059.812753:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812773:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812788:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:3.0:1789050059.812791:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789050059.812796:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.812802:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b79675 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050059.814664:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.815465:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550080 00000100:00100000:0.0:1789050059.815476:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550080 00000100:00100000:0.0:1789050059.815538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 178 00000100:00100000:0.0:1789050059.815548:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+24:11493:x1875954691550080:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.815569:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050059.815586:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa94 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.815653:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 25 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.815668:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 25 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.815699:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:0.0:1789050059.815702:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050059.815706:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331600, rc 0) 00000100:00100000:0.0:1789050059.815765:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+25:11493:x1875954691550080:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 218us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.815772:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 178 00000100:00100000:0.0:1789050059.820293:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.820390:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550208 00000100:00100000:1.0:1789050059.820400:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550208 00000100:00100000:1.0:1789050059.820466:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:1.0:1789050059.820477:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2350:x1875954691550208:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789050059.820816:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691550208:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 340us (530us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789050059.820824:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00080000:0.0:1789050059.821019:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050059.826265:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.826462:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550464 00000100:00100000:3.0:1789050059.826471:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550464 00000100:00100000:3.0:1789050059.826523:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:3.0:1789050059.826534:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+25:11493:x1875954691550464:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050059.826763:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11493:x1875954691550464:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 230us (506us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789050059.826771:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:3.0:1789050059.831301:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.831633:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550720 00000100:00100000:1.0:1789050059.831642:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550720 00000100:00100000:1.0:1789050059.831699:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 179 00000100:00100000:1.0:1789050059.831709:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11493:x1875954691550720:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789050059.831851:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11493:x1875954691550720:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 143us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.831858:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 179 00000100:00100000:0.0:1789050059.838459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.838549:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550848 00000100:00100000:3.0:1789050059.838559:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550848 00000100:00100000:3.0:1789050059.838622:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 180 00000100:00100000:3.0:1789050059.838632:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+26:11493:x1875954691550848:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050059.838650:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050059.838670:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fa9b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838761:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838774:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838786:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050059.838821:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050059.838839:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838864:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b79683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa9b expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838881:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa9b expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050059.838889:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:3.0:1789050059.838892:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789050059.838896:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07800, rc 0) 00000100:00100000:3.0:1789050059.838952:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+27:11493:x1875954691550848:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 320us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.838959:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 180 00000100:00100000:3.0:1789050059.844082:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.844158:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691550976 00000100:00100000:0.0:1789050059.844275:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691550976 00000100:00100000:0.0:1789050059.844355:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:0.0:1789050059.844365:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691550976:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.844381:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050059.844399:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34faa2 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050059.844425:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb8d21d84140, blocks: 0x1 00010000:00010000:0.0:1789050059.844444:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1789050059.844448:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050059.844457:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.844474:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.844499:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331200, rc 0) 00000100:00100000:0.0:1789050059.844565:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691550976:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 201us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.844572:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:1.0:1789050059.847927:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.848047:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551232 00000100:00100000:3.0:1789050059.848056:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551232 00000100:00100000:3.0:1789050059.848123:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 181 00000100:00100000:3.0:1789050059.848132:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073caff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:11493:x1875954691551232:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050059.848258:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073caff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:11493:x1875954691551232:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 126us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050059.848265:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 181 00000100:00100000:1.0:1789050059.851428:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.851544:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551360 00000100:00100000:0.0:1789050059.851554:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551360 00000100:00100000:0.0:1789050059.851646:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:0.0:1789050059.851656:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:11493:x1875954691551360:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.851687:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050059.851704:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34faa9 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.851734:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 9 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.851742:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050059.851747:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050059.851752:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.851780:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 9 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.851793:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 9 pid: 8215 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.851806:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704127232:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050059.851898:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702c15240 going to sleep for 11 seconds 00000100:00100000:3.0:1789050059.854947:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.855028:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551488 00000100:00100000:1.0:1789050059.855038:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551488 00010000:00010000:1.0:1789050059.855075:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 10 pid: 8215 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.855131:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:1.0:1789050059.855141:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+10:2348:x1875954691551488:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050059.855154:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050059.855184:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 10 pid: 8215 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.855196:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 10 pid: 8215 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.855239:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050059.855243:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050059.855251:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 10 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.855261:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 10 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.855294:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 10 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.855308:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1875954704127360:192.168.206.1@tcp:105: 00000100:00100000:1.0:1789050059.855375:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507207d4a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789050059.855550:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b79691 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa2 expref: 10 pid: 8215 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.855564:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704127232:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050059.855607:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.855624:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330e00, rc 0) 00000100:00100000:0.0:1789050059.855661:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:11493:x1875954691551360:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 4006us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.855669:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050059.862408:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1875954704127360:192.168.206.1@tcp:105: 00010000:00010000:1.0:1789050059.862449:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050059.862511:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691551488:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 7370us (7571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.862521:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:1.0:1789050059.864000:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050059.864050:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551616 00000100:00100000:3.0:1789050059.864059:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551616 00002000:00100000:3.0:1789050059.864103:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff95073cafed80 x1875954691551616/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:560/0 lens 504/0 e 0 to 0 dl 1789050070 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050059.864114:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073cafed80 with x1875954691551616 ext(0->8) 00002000:00010000:3.0:1789050059.864119:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073cafed80 00000100:00100000:3.0:1789050059.864151:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050059.864160:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691551616:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789050059.864825:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+10:2348:x1875954691551616:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 Request processed in 663us (838us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789050059.864833:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00002000:00100000:3.0:1789050059.864841:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff95073cafed80 x1875954691551616/t4294967314(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:560/0 lens 504/448 e 0 to 0 dl 1789050070 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050059.864849:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073cafed80 with x1875954691551616 ext(0->8) 00002000:00010000:3.0:1789050059.864853:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073cafed80 00000100:00100000:3.0:1789050059.867669:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.867813:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551744 00000100:00100000:0.0:1789050059.867822:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551744 00000100:00100000:0.0:1789050059.867880:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 182 00000100:00100000:0.0:1789050059.867898:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+27:11493:x1875954691551744:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789050059.905891:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+27:11493:x1875954691551744:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 37993us (38223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.905904:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 182 00000020:00080000:0.0:1789050059.905937:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1789050059.905962:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000001:00080000:0.0:1789050059.905980:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00000004:00080000:0.0:1789050059.905999:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1789050059.906112:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704127488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050059.906161:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050059.906235:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127488 00000100:00100000:0.0:1789050059.906241:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127488 00000100:00100000:0.0:1789050059.906276:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789050059.906284:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704127488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789050059.906557:0:6670:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789050059.906561:0:6670:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789050060629509570 00002000:00010000:0.0:1789050059.906563:0:6670:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789050059.906573:0:6670:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789050060573000000 -> 1789050060629509570 00002000:00010000:0.0:1789050059.906575:0:6670:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789050059.906620:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704127488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 336us (459us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789050059.906628:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1789050059.906729:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c517480/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789050059.906735:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704127488:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789050059.906848:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789050059.906858:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789050059.915887:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.917513:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691551872 00000100:00100000:1.0:1789050059.917521:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691551872 00000100:00100000:1.0:1789050059.917568:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:1.0:1789050059.917579:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691551872:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789050059.917642:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704127616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050059.917695:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050059.917739:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704127616 00000100:00100000:1.0:1789050059.917743:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704127616 00000100:00100000:1.0:1789050059.917770:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050059.917778:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073caff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704127616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050059.917802:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050059.917841:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073caff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704127616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.917848:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050059.917890:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704127616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789050059.920784:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789050059.964961:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1789050059.964978:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789050059.964985:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1789050059.965474:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691551872:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 47893us (49591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.965486:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:3.0:1789050059.968630:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.968734:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552128 00000100:00100000:1.0:1789050059.968755:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552128 00000100:00100000:1.0:1789050059.968850:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 183 00000100:00100000:1.0:1789050059.968860:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+18:11493:x1875954691552128:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050059.968919:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050059.968944:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7968a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa9b expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.968963:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.968968:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050059.968995:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.969008:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.969018:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050059.969290:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f8cc6a68 reply state 000000006910485c transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.969300:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050059.969398:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:11493:x1875954691552128:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 539us (776us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789050059.969405:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 183 00010000:00010000:2.0:1789050059.971735:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971750:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971757:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971764:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050059.971768:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971776:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971792:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:2.0:1789050059.971795:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050059.971800:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050059.971806:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7969f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.973457:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.973704:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552256 00000100:00100000:0.0:1789050059.973714:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552256 00000100:00100000:0.0:1789050059.973769:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:0.0:1789050059.973778:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691552256:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789050059.974011:0:6670:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789050059.974015:0:6670:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789050060629509570 -> 1789050060061000000 00002000:00010000:0.0:1789050059.974018:0:6670:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789050058662000000 00002000:00010000:0.0:1789050059.974021:0:6670:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789050060629509570 -> 1789050060061000000 00002000:00010000:0.0:1789050059.974023:0:6670:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789050059.974079:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2350:x1875954691552256:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 302us (628us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789050059.974088:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:3.0:1789050059.979390:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.979452:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552512 00000100:00100000:1.0:1789050059.979461:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552512 00000100:00100000:1.0:1789050059.979519:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 184 00000100:00100000:1.0:1789050059.979529:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+18:11493:x1875954691552512:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789050059.979620:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.979638:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.979647:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.979677:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.979689:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 18 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.979702:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704127744:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050059.979780:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050059.982999:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704127744:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050059.983032:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.984458:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.984641:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552640 00000100:00100000:1.0:1789050059.984649:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552640 00010000:00010000:1.0:1789050059.984686:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.984756:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:1.0:1789050059.984766:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:2348:x1875954691552640:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050059.984794:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050059.984807:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.984819:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.984841:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7966e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa8d expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.984859:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:1.0:1789050059.984863:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.984873:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.984950:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.985040:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050059.985084:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985093:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.985095:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+18:2348:x1875954691552640:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 330us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.985102:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 69 00010000:00010000:0.0:1789050059.985117:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985132:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985143:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985149:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050059.985153:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985161:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985169:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:0.0:1789050059.985172:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789050059.985187:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.985194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530e00/0x9df728c939b796a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.985401:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+17:11493:x1875954691552512:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 Request processed in 5872us (6019us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789050059.985410:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 184 00000100:00100000:3.0:1789050059.987481:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.987559:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552768 00000100:00100000:1.0:1789050059.987579:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552768 00000100:00100000:1.0:1789050059.987650:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:1.0:1789050059.987661:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691552768:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789050059.987701:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.987720:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.987729:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050059.987733:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050059.987737:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.987771:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.987784:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 8 pid: 6672 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.987797:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704127872:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050059.987871:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050059.990804:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704127872:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050059.990834:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050059.991359:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050059.991431:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691552896 00000100:00100000:1.0:1789050059.991439:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691552896 00010000:00010000:1.0:1789050059.991474:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050059.991515:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:1.0:1789050059.991525:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691552896:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050059.991540:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050059.991562:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.991573:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.991605:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79698 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faa9 expref: 9 pid: 6672 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.991621:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050059.991625:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050059.991631:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.991641:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050059.991732:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050059.991791:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691552896:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 267us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050059.991798:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 70 00010000:00010000:0.0:1789050059.993431:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993447:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993477:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993506:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993515:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993523:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050059.993527:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993537:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993555:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.993564:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df6eb7e2/0x9df728c939b796ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.993702:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691552768:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 6041us (6226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050059.993711:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:1.0:1789050059.996629:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050059.996830:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553152 00000100:00100000:0.0:1789050059.996840:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553152 00000100:00100000:0.0:1789050059.997030:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 185 00000100:00100000:0.0:1789050059.997052:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+17:11493:x1875954691553152:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789050059.997126:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997143:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997154:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997389:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997401:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997409:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997441:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050059.997454:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 18 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050059.997467:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128000:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050059.997535:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050060.000738:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.000835:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128000:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050060.000857:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.001036:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553280 00000100:00100000:3.0:1789050060.001043:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553280 00010000:00010000:3.0:1789050060.001077:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.001115:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:3.0:1789050060.001125:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:2348:x1875954691553280:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050060.001139:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050060.001145:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001156:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001187:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b7967c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa94 expref: 19 pid: 5818 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001234:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:3.0:1789050060.001239:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001249:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001263:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.001285:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050060.001334:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+18:2348:x1875954691553280:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 210us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.001341:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 71 00010000:00010000:0.0:1789050060.001530:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.001537:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789050060.001726:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000001:00080000:0.0:1789050060.001856:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00000001:00080000:0.0:1789050060.002030:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00000100:00100000:0.0:1789050060.002106:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704128128:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050060.002147:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050060.002190:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cdf6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050060.002529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128128 00000100:00100000:3.0:1789050060.002535:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128128 00000100:00100000:3.0:1789050060.002572:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050060.002580:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704128128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050060.002656:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704128128:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.002663:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050060.002819:0:8158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789050060.002825:0:8158:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c517480, transno 4294967315 00000100:00100000:3.0:1789050060.002873:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704128128:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789050060.003319:0:8158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000100:00100000:3.0:1789050060.003372:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704128256:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050060.003412:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050060.003432:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff95071192c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789050060.003444:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704128256 00000100:00100000:3.0:1789050060.003447:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704128256 00000100:00100000:3.0:1789050060.003465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050060.003470:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8158:x1875954704128256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789050060.003613:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8158:x1875954704128256:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (200us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789050060.003626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050060.003661:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8158:1875954704128256:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789050060.003685:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003694:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003702:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003708:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.003712:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003719:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003730:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950732cb4a00) 00010000:00010000:3.0:1789050060.003733:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050060.003738:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003744:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b796bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003772:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003780:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003795:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003800:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.003803:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003809:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003818:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:3.0:1789050060.003820:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050060.003823:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003829:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b795f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003848:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003860:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003869:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003892:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.003905:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 21 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.003922:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128384:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050060.003969:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050060.008847:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.009407:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553408 00000100:00100000:1.0:1789050060.009417:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553408 00010000:00010000:1.0:1789050060.009457:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 22 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050060.009494:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:1.0:1789050060.009503:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+22:2347:x1875954691553408:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050060.009517:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050060.009524:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 22 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.009536:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 22 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.009558:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:1.0:1789050060.009563:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.009573:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.009581:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.009620:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050060.010657:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b79613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fa78 expref: 22 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050060.010676:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128384:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050060.011710:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011722:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011729:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011741:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011746:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011767:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011773:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.011778:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011785:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011800:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:0.0:1789050060.011803:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050060.011807:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011813:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b796c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011826:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011832:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011838:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011844:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.011847:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011860:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.011869:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dc600) 00010000:00010000:0.0:1789050060.011871:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050060.011874:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.012075:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b796b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050060.012478:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050060.012483:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050060.013116:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789050060.013126:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050060.013516:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:2347:x1875954691553408:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 4008us (4672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050060.013527:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:0.0:1789050060.013787:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+20:11493:x1875954691553152:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 16735us (17164us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789050060.013795:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 185 00000020:00080000:0.0:1789050060.013800:0:8158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789050060.016738:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.016804:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553664 00000100:00100000:0.0:1789050060.016812:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553664 00000100:00100000:0.0:1789050060.016861:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:0.0:1789050060.016870:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:11493:x1875954691553664:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050060.017460:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789050060.017548:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00010000:00010000:0.0:1789050060.017587:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017613:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017626:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017644:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017651:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017658:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017675:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050060.017741:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+22:11493:x1875954691553664:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 871us (1010us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789050060.017748:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000020:00080000:0.0:1789050060.017753:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789050060.017794:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050060.017799:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017806:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050060.017810:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017818:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017828:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff950714b52200) 00010000:00010000:0.0:1789050060.017831:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789050060.017835:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017850:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b796c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.017864:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050060.017865:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050060.017867:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050060.408683:0:12493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789050060.408692:0:12493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050060.408736:0:12493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789050060.408741:0:12493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050060.494644:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.494688:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.494826:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553792 00000100:00100000:0.0:1789050060.494836:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553792 00000100:00100000:0.0:1789050060.494882:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 285 00000100:00100000:0.0:1789050060.494903:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691553792:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050060.494967:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691553792:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 66us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050060.494974:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 285 00000100:00100000:1.0:1789050060.495085:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.495512:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691553920 00000100:00100000:0.0:1789050060.495518:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691553920 00000100:00100000:0.0:1789050060.495558:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:0.0:1789050060.495567:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691553920:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050060.495812:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691553920:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 245us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050060.495819:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00080000:0.0:1789050060.495838:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050060.496034:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691554048 00000100:00100000:3.0:1789050060.496040:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691554048 00000100:00100000:3.0:1789050060.496451:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00100000:3.0:1789050060.496461:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691554048:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050060.496501:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2349:x1875954691554048:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 42us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.496508:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 133 00000100:00080000:0.0:1789050060.497001:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050060.517134:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.517355:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691554304 00000100:00100000:1.0:1789050060.517372:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691554304 00000100:00100000:1.0:1789050060.517424:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 186 00000100:00100000:1.0:1789050060.517435:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+22:11508:x1875954691554304:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050060.517458:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050060.517477:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530200/0x9df728c939b796d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fab0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.517568:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531a00/0x9df728c939b796d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.517583:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531a00/0x9df728c939b796d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.517607:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531a00/0x9df728c939b796d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050060.517620:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789050060.517733:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530200/0x9df728c939b796d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab0 expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.517769:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531a00/0x9df728c939b796d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab0 expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.517778:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050060.517781:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789050060.517785:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531a00, rc 0) 00000100:00100000:1.0:1789050060.517850:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+24:11508:x1875954691554304:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 416us (724us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789050060.517857:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 186 00000100:00100000:1.0:1789050060.530624:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.530705:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691554432 00000100:00100000:3.0:1789050060.530714:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691554432 00000100:00100000:3.0:1789050060.531451:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 187 00000100:00100000:3.0:1789050060.531463:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+24:11508:x1875954691554432:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050060.531531:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531546:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531558:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531572:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531602:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531611:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531819:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531828:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531835:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050060.531871:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531895:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531903:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531910:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531916:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.531920:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531928:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531946:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050060.531950:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.531955:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531962:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b796e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531973:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531979:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531985:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.531990:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.531993:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532000:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532008:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dce00) 00010000:00010000:3.0:1789050060.532010:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.532013:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532019:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b796ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532047:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532053:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532059:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532065:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.532068:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532074:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532082:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050060.532084:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.532087:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.532093:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b796f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.532428:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+24:11508:x1875954691554432:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 965us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.532435:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 187 00000100:00100000:0.0:1789050060.579012:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.579150:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691554688 00000100:00100000:3.0:1789050060.579465:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691554688 00000100:00100000:3.0:1789050060.579561:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 188 00000100:00100000:3.0:1789050060.579579:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+24:11511:x1875954691554688:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050060.579611:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050060.579630:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b796fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fab7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579695:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579710:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579722:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579736:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579743:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.579750:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580007:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580016:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580024:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050060.580045:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789050060.580134:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580141:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580148:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580153:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.580158:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580179:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580191:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050060.580194:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.580221:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580229:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580241:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580248:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580264:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580269:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.580272:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580279:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580286:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dcf00) 00010000:00010000:3.0:1789050060.580289:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.580291:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580297:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b79708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580338:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b796fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580351:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 26 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.580370:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050060.580372:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050060.580374:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06e00, rc 0) 00000100:00100000:3.0:1789050060.580433:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11511:x1875954691554688:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 856us (1428us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789050060.580448:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 188 00000100:00100000:3.0:1789050060.586325:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.586481:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691554816 00000100:00100000:0.0:1789050060.586491:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691554816 00000100:00100000:0.0:1789050060.586547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 189 00000100:00100000:0.0:1789050060.586557:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:11511:x1875954691554816:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:0.0:1789050060.586628:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586644:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586655:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586678:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586685:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586692:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586698:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.586703:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586710:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586721:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:0.0:1789050060.586725:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050060.586730:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.586747:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7971d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050060.586814:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:11511:x1875954691554816:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 259us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050060.586821:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 189 00000100:00100000:1.0:1789050060.596688:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.598128:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555072 00000100:00100000:3.0:1789050060.598142:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555072 00000100:00100000:3.0:1789050060.598328:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789050060.598340:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11511:x1875954691555072:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050060.598573:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+27:11511:x1875954691555072:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 236us (1895us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789050060.598581:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:0.0:1789050060.648342:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.648422:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555328 00000100:00100000:3.0:1789050060.648432:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555328 00000100:00100000:3.0:1789050060.648486:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 190 00000100:00100000:3.0:1789050060.648496:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+27:11045:x1875954691555328:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050060.648516:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050060.648534:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fabe expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.648638:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.648664:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.648674:0:8158:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.648700:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.648725:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 28 pid: 5817 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.648738:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128512:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050060.648822:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050060.651845:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8158:1875954704128512:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050060.651884:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050060.659050:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050060.662007:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555456 00000100:00100000:2.0:1789050060.662020:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555456 00010000:00010000:2.0:1789050060.662066:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 29 pid: 5817 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050060.662167:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 73 00000100:00100000:2.0:1789050060.662178:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:2347:x1875954691555456:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050060.662192:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050060.662226:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 29 pid: 5817 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662240:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 29 pid: 5817 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662261:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7970f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab7 expref: 29 pid: 5817 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662279:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:2.0:1789050060.662284:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662293:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662300:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.662357:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050060.662415:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+28:2347:x1875954691555456:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 238us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.662424:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 73 00010000:00010000:3.0:1789050060.662429:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.662440:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050060.662464:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789050060.663673:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 29 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.663698:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 28 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.663707:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050060.663710:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050060.663713:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06c00, rc 0) 00000100:00100000:3.0:1789050060.663835:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+28:11045:x1875954691555328:12345-192.168.206.1@tcp:101:bash.0 Request processed in 15339us (15499us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789050060.663857:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 190 00000100:00100000:1.0:1789050060.668106:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.668250:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555712 00000100:00100000:3.0:1789050060.668261:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555712 00000100:00100000:3.0:1789050060.668323:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 191 00000100:00100000:3.0:1789050060.668332:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+28:11045:x1875954691555712:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:3.0:1789050060.668600:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.668617:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.668629:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050060.668686:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000004:00010000:3.0:1789050060.668712:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000001dac1d37 reply state 0000000020d492ea transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.668720:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789050060.668769:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967480 00000100:00100000:3.0:1789050060.669129:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+32:11045:x1875954691555712:12345-192.168.206.1@tcp:36:bash.0 Request processed in 796us (1029us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789050060.669138:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 191 00000020:00080000:3.0:1789050060.669143:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789050060.672365:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050060.672602:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555840 00000100:00100000:2.0:1789050060.672611:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555840 00010000:00010000:3.0:1789050060.672648:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.672661:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050060.672676:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 192 00010000:00010000:3.0:1789050060.672685:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050060.672685:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+32:11045:x1875954691555840:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050060.672692:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.672696:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.672702:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.672705:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050060.672717:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050060.672720:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050060.672721:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fac5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.672724:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.672731:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.672772:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79740 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fac5 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.672785:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79740 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fac5 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050060.672803:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:2.0:1789050060.672805:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050060.672808:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050060.672860:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+32:11045:x1875954691555840:12345-192.168.206.1@tcp:101:bash.0 Request processed in 176us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050060.672867:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 192 00000100:00100000:2.0:1789050060.677130:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.677233:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691555968 00000100:00100000:1.0:1789050060.677242:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691555968 00000100:00100000:1.0:1789050060.677284:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:1.0:1789050060.677292:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:11045:x1875954691555968:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050060.677306:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050060.677323:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34facc expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050060.677347:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb8d0353c140, atime: 0x18d3fb8caff0b580, ctime: 0x18d3fb8d0353c140, blocks: 0xb 00010000:00010000:1.0:1789050060.677367:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1789050060.677371:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050060.677378:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.677413:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.677424:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531800, rc 0) 00000100:00100000:1.0:1789050060.677471:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:11045:x1875954691555968:12345-192.168.206.1@tcp:101:bash.0 Request processed in 180us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050060.677478:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:0.0:1789050060.682641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050060.682752:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556096 00000100:00100000:2.0:1789050060.682774:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556096 00002000:00010000:2.0:1789050060.683056:0:6678:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789050060.683061:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c517480 with x1875954691556096 ext(0->18446744073709551615) 00002000:00010000:2.0:1789050060.683072:0:6678:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c517480. 00000100:00100000:2.0:1789050060.683103:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789050060.683112:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691556096:12345-192.168.206.1@tcp:10:bash.0 00002000:00010000:2.0:1789050060.683404:0:6678:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789050060.683408:0:6678:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789050060061000000 -> 1789050061434000000 00002000:00010000:2.0:1789050060.683411:0:6678:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789050058662000000 -> 1789050058662000000 00002000:00010000:2.0:1789050060.683413:0:6678:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789050060061000000 -> 1789050061434000000 00002000:00010000:2.0:1789050060.683416:0:6678:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789050060.683539:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691556096:12345-192.168.206.1@tcp:10:bash.0 Request processed in 427us (905us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789050060.683546:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00002000:00010000:2.0:1789050060.683550:0:6678:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789050060.683552:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c517480 with x1875954691556096 ext(0->18446744073709551615) 00002000:00010000:2.0:1789050060.683557:0:6678:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073c517480. 00000100:00100000:2.0:1789050060.755079:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050060.756694:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556224 00000100:00100000:3.0:1789050060.756707:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556224 00000100:00100000:3.0:1789050060.756759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 193 00000100:00100000:3.0:1789050060.756769:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+32:11525:x1875954691556224:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050060.756833:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.756850:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.756863:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.756895:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.756903:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.756909:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757116:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757125:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757132:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050060.757169:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757180:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757186:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757193:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757231:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.757237:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757250:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757262:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050060.757265:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.757269:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757276:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b7974e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757288:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757294:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757300:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757305:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.757307:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757313:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757319:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dcf00) 00010000:00010000:3.0:1789050060.757322:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.757324:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757342:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757358:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757363:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757369:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757373:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050060.757376:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757381:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757388:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050060.757390:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050060.757392:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050060.757398:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7975c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050060.758763:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+32:11525:x1875954691556224:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 1988us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050060.758775:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 193 00000100:00100000:3.0:1789050060.803521:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.803707:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556480 00000100:00100000:0.0:1789050060.803716:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556480 00000100:00100000:0.0:1789050060.803776:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 194 00000100:00100000:0.0:1789050060.803786:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+32:11528:x1875954691556480:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050060.803805:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050060.803823:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fad3 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803904:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803918:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803930:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803944:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803964:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.803973:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804263:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804274:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804282:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050060.804291:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789050060.804376:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804384:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804389:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804395:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.804399:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804406:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804428:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050060.804431:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050060.804435:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804440:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7976a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804465:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804471:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804476:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804480:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.804482:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804488:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804495:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950714b52200) 00010000:00010000:0.0:1789050060.804497:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050060.804499:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804504:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79771 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804551:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fad3 expref: 35 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804565:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fad3 expref: 34 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.804571:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:0.0:1789050060.804573:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789050060.804575:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330a00, rc 0) 00000100:00100000:0.0:1789050060.804646:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+34:11528:x1875954691556480:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 862us (1133us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789050060.804654:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 194 00000100:00100000:1.0:1789050060.812241:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.812312:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556608 00000100:00100000:0.0:1789050060.812321:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556608 00000100:00100000:0.0:1789050060.812368:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 195 00000100:00100000:0.0:1789050060.812376:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073caffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+34:11528:x1875954691556608:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:0.0:1789050060.812435:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.812459:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 34 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.812468:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.812496:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 34 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.812525:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 34 pid: 8158 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050060.812538:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704128640:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050060.812632:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff95072050e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789050060.814926:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.815021:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556864 00000100:00100000:1.0:1789050060.815030:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556864 00000100:00100000:1.0:1789050060.815083:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:1.0:1789050060.815093:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+35:5588:x1875954691556864:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1789050060.815358:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:1.0:1789050060.815474:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+37:5588:x1875954691556864:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 382us (554us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789050060.815481:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00000020:00080000:1.0:1789050060.815485:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789050060.815870:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704128640:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050060.815894:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050060.820785:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.821257:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691556992 00000100:00100000:1.0:1789050060.821267:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691556992 00010000:00010000:1.0:1789050060.821307:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 37 pid: 8158 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050060.821399:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:1.0:1789050060.821410:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+37:2348:x1875954691556992:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050060.821423:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050060.821442:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 37 pid: 8158 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821464:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 37 pid: 8158 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821484:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7972b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fabe expref: 37 pid: 8158 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821500:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:1.0:1789050060.821504:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821512:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821519:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050060.821557:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050060.821617:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+36:2348:x1875954691556992:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 209us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050060.821623:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 74 00010000:00010000:0.0:1789050060.821684:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821693:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821719:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821727:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821733:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821739:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.821744:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821752:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821769:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:0.0:1789050060.821772:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050060.821776:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.821783:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b79786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050060.821821:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073caffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+35:11528:x1875954691556608:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 9445us (9586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050060.821828:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 195 00000100:00100000:2.0:1789050060.831994:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.832071:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691557248 00000100:00100000:1.0:1789050060.832081:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691557248 00000100:00100000:1.0:1789050060.832134:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:1.0:1789050060.832145:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+35:11528:x1875954691557248:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:1.0:1789050060.832416:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+36:11528:x1875954691557248:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 269us (426us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789050060.832446:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00010000:00010000:2.0:1789050060.939351:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050060.981661:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050060.981765:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691557504 00000100:00100000:0.0:1789050060.981775:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691557504 00000100:00100000:0.0:1789050060.981841:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 196 00000100:00100000:0.0:1789050060.981851:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+36:11539:x1875954691557504:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:0.0:1789050060.981875:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050060.981894:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7978d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fada expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.981960:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.981974:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.981986:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.981999:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982021:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982029:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982286:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b797a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982295:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b797a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982303:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b797a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050060.982313:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789050060.982397:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982405:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982411:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982417:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.982421:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982429:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982462:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050060.982465:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050060.982471:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982477:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b79794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982488:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982494:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982499:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982504:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050060.982506:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982511:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982518:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950714b52200) 00010000:00010000:0.0:1789050060.982520:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050060.982524:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982529:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7979b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982575:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7978d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fada expref: 39 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982598:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b797a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fada expref: 38 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050060.982605:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:0.0:1789050060.982606:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050060.982609:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331000, rc 0) 00000100:00100000:0.0:1789050060.982667:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+38:11539:x1875954691557504:12345-192.168.206.1@tcp:101:cat.0 Request processed in 817us (1014us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789050060.982674:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 196 00000100:00100000:2.0:1789050060.996350:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050060.996569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691557760 00000100:00100000:1.0:1789050060.996578:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691557760 00000100:00100000:1.0:1789050060.996645:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050060.996656:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+38:11539:x1875954691557760:12345-192.168.206.1@tcp:35:cat.0 00000100:00100000:1.0:1789050060.996869:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+39:11539:x1875954691557760:12345-192.168.206.1@tcp:35:cat.0 Request processed in 214us (527us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789050060.996877:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:1.0:1789050061.027626:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.027702:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558016 00000100:00100000:3.0:1789050061.027712:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558016 00000100:00100000:3.0:1789050061.027783:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 197 00000100:00100000:3.0:1789050061.027795:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+39:11540:x1875954691558016:12345-192.168.206.1@tcp:36:rm.0 00010000:00010000:3.0:1789050061.027884:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789050061.027911:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b797a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fada expref: 39 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.027931:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b79778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fad3 expref: 38 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.027944:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b79740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fac5 expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.027953:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050061.027964:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050061.027984:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.027996:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028004:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028016:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028033:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028040:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028317:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028326:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.028334:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789050061.028569:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789050061.029327:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1789050061.029337:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297017136415ns, next at 298017134245ns, rc = 0 00010000:00010000:3.0:1789050061.029394:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029407:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029414:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029422:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029428:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029443:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029655:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050061.029675:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029681:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029688:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029694:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050061.029698:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029705:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029716:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dca00) 00010000:00010000:3.0:1789050061.029719:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789050061.029723:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029729:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b797be lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029745:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029750:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029762:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029767:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050061.029770:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029775:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029782:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050061.029785:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050061.029788:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.029793:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b797b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050061.029801:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000001259f97c reply state 000000003519f7b2 transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.029810:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050061.029902:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+38:11540:x1875954691558016:12345-192.168.206.1@tcp:36:rm.0 Request processed in 2107us (2455us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1789050061.029910:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 197 00010000:00010000:3.0:1789050061.031135:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031148:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031176:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031182:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050061.031186:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031193:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031230:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.031232:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050061.031236:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.031243:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b797b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033060:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050061.033070:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033079:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050061.033083:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033092:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033106:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9507114dca00) 00010000:00010000:1.0:1789050061.033108:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050061.033113:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033119:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b797c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.033141:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050061.033155:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050061.033157:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050061.100733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.100945:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558272 00000100:00100000:0.0:1789050061.100955:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558272 00000100:00100000:0.0:1789050061.101011:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 198 00000100:00100000:0.0:1789050061.101021:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+37:11546:x1875954691558272:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:0.0:1789050061.101045:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050061.101070:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b797cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fae1 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101180:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101195:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101235:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101264:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101271:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101279:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050061.101793:0:8158:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789050061.101941:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101951:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101959:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101990:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.101997:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102003:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102008:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050061.102012:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102029:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102040:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050061.102043:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050061.102047:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102052:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b797d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050061.102066:0:8158:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000003c8d6dd1 reply state 0000000077975fb9 transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050061.102073:0:8158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789050061.102098:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b797cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 40 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102110:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 39 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.102117:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:0.0:1789050061.102119:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050061.102121:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331600, rc 0) 00000100:00100000:0.0:1789050061.102194:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+40:11546:x1875954691558272:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1174us (1470us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1789050061.102245:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 198 00010000:00010000:3.0:1789050061.109479:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109557:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109566:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109572:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050061.109577:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109612:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109629:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950714b52200) 00010000:00010000:3.0:1789050061.109633:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050061.109638:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.109643:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b797da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050061.109734:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.110332:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558400 00000100:00100000:0.0:1789050061.110341:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558400 00000100:00100000:0.0:1789050061.110446:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:0.0:1789050061.110456:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691558400:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:0.0:1789050061.110472:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050061.110487:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fae8 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789050061.110510:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789050061.110528:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789050061.110532:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050061.110540:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 6 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.110557:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 6 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.110568:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331200, rc 0) 00000100:00100000:0.0:1789050061.110630:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691558400:12345-192.168.206.1@tcp:101:bash.0 Request processed in 176us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050061.110637:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:3.0:1789050061.113393:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050061.113874:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558528 00000100:00100000:2.0:1789050061.113890:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558528 00000100:00100000:2.0:1789050061.113940:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050061.113949:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+6:11546:x1875954691558528:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050061.113975:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050061.113990:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34faef expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.114017:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.114026:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050061.114030:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050061.114035:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.114062:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.114075:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050061.114088:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1875954704128768:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050061.114175:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050061.116626:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1875954704128768:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050061.116659:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.116678:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050061.116749:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:11546:x1875954691558528:12345-192.168.206.1@tcp:101:bash.0 Request processed in 2801us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.116757:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050061.118821:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.118888:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558656 00000100:00100000:3.0:1789050061.118897:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558656 00010000:00010000:3.0:1789050061.118933:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.118968:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:3.0:1789050061.118978:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691558656:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050061.118991:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050061.119013:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.119025:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.119239:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b797ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae8 expref: 7 pid: 8215 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.119271:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050061.119275:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050061.119285:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.119295:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.119331:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.119345:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607605500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5802:1875954704128896:192.168.206.1@tcp:105: 00000100:00100000:3.0:1789050061.119415:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050061.122899:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050061.122899:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607605500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5802:1875954704128896:192.168.206.1@tcp:105: 00010000:00010000:2.0:1789050061.122921:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050061.122974:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+6:2347:x1875954691558656:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 3997us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.122984:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:0.0:1789050061.125170:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691558912 00000100:00100000:0.0:1789050061.125182:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691558912 00000100:00100000:0.0:1789050061.125258:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:0.0:1789050061.125268:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+39:11546:x1875954691558912:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:0.0:1789050061.125507:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789050061.125735:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+41:11546:x1875954691558912:12345-192.168.206.1@tcp:35:bash.0 Request processed in 467us (2853us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1789050061.125759:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 55 00000020:00080000:0.0:1789050061.125764:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789050061.276173:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.276425:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559040 00000100:00100000:1.0:1789050061.276436:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559040 00000100:00100000:1.0:1789050061.276530:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 199 00000100:00100000:1.0:1789050061.276542:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+41:11562:x1875954691559040:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050061.276564:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050061.276591:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b797fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34faf6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276653:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276666:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276682:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050061.276715:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789050061.276718:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050061.276734:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276756:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b797fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faf6 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276774:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faf6 expref: 42 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.276802:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050061.276805:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050061.276808:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530c00, rc 0) 00000100:00100000:1.0:1789050061.276919:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+42:11562:x1875954691559040:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 379us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.276926:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 199 00000100:00100000:3.0:1789050061.285646:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.285871:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559296 00000100:00100000:0.0:1789050061.285880:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559296 00000100:00100000:0.0:1789050061.285942:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 200 00000100:00100000:0.0:1789050061.285951:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+42:11562:x1875954691559296:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050061.285969:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050061.285987:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7980b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fafd expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.286075:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.286088:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.286098:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050061.286109:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789050061.286270:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330600/0x9df728c939b7980b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fafd expref: 45 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.286288:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fafd expref: 44 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.286296:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:0.0:1789050061.286299:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050061.286316:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330e00, rc 0) 00000100:00100000:0.0:1789050061.286370:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+44:11562:x1875954691559296:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 419us (740us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1789050061.286376:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 200 00000100:00100000:2.0:1789050061.293060:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.293172:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559552 00000100:00100000:3.0:1789050061.293181:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559552 00000100:00100000:3.0:1789050061.293263:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 201 00000100:00100000:3.0:1789050061.293273:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+44:11562:x1875954691559552:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050061.293296:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050061.293314:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb04 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.293402:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.293429:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.293440:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050061.293466:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789050061.295772:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb04 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.295811:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb04 expref: 46 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.295820:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:3.0:1789050061.295824:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789050061.295827:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07200, rc 0) 00000100:00100000:3.0:1789050061.295902:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+46:11562:x1875954691559552:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2628us (2848us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1789050061.295910:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 201 00000100:00100000:3.0:1789050061.299928:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.300013:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559680 00000100:00100000:1.0:1789050061.300023:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559680 00000100:00100000:1.0:1789050061.300087:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:1.0:1789050061.300098:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+46:2348:x1875954691559680:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050061.300112:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050061.300133:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330e00/0x9df728c939b79812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fafd expref: 46 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.300152:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:1.0:1789050061.300157:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050061.300255:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+45:2348:x1875954691559680:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.300261:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:0.0:1789050061.303935:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.304128:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559808 00000100:00100000:3.0:1789050061.304138:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559808 00000100:00100000:3.0:1789050061.304231:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:3.0:1789050061.304241:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+6:2348:x1875954691559808:12345-192.168.206.1@tcp:1:lfs.0 00010000:00010000:3.0:1789050061.304282:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.304319:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.304329:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050061.304333:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050061.304338:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.304376:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.304390:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 6 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.304404:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607604000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704129024:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050061.304503:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050061.311598:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607604000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1875954704129024:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050061.311625:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050061.315260:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.315338:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691559936 00000100:00100000:3.0:1789050061.315347:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691559936 00002000:00100000:3.0:1789050061.315394:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff95073c514700 x1875954691559936/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:562/0 lens 504/0 e 0 to 0 dl 1789050072 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050061.315404:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c514700 with x1875954691559936 ext(0->8) 00010000:00010000:3.0:1789050061.315412:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 7 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.315428:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 7 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050061.315448:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95073c514700 00000100:00100000:3.0:1789050061.315482:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:3.0:1789050061.315491:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691559936:12345-192.168.206.1@tcp:4:lfs.0 00000100:00100000:3.0:1789050061.315946:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691559936:12345-192.168.206.1@tcp:4:lfs.0 Request processed in 455us (693us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789050061.315953:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00002000:00100000:3.0:1789050061.315961:0:6677:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff95073c514700 x1875954691559936/t4294967308(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:562/0 lens 504/448 e 0 to 0 dl 1789050072 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789050061.315969:0:6677:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c514700 with x1875954691559936 ext(0->8) 00010000:00010000:3.0:1789050061.315974:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.315985:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050061.315992:0:6677:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95073c514700 00000100:00100000:3.0:1789050061.321130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.321296:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560064 00000100:00100000:0.0:1789050061.321305:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560064 00010000:00010000:0.0:1789050061.321340:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050061.321379:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:0.0:1789050061.321388:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+9:2348:x1875954691560064:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050061.321403:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789050061.321420:0:5802:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789050061.321423:0:5802:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789050061890983037 00002000:00010000:0.0:1789050061.321425:0:5802:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789050062071037862 00002000:00010000:0.0:1789050061.321427:0:5802:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789050061890983037 00010000:00010000:0.0:1789050061.321432:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.321445:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.321480:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b797f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faef expref: 9 pid: 6670 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.321496:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050061.321501:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050061.321507:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.321516:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.321552:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050061.321611:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691560064:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 223us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050061.321618:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 76 00010000:00010000:3.0:1789050061.322753:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322767:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322803:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322823:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322830:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322837:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050061.322842:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322851:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322866:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.322873:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005211ba1f/0x9df728c939b79835 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.322954:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691559808:12345-192.168.206.1@tcp:1:lfs.0 Request processed in 18713us (19025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050061.322962:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:3.0:1789050061.335626:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.335810:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560320 00000100:00100000:1.0:1789050061.335820:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560320 00000100:00100000:1.0:1789050061.335875:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:1.0:1789050061.335885:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+45:11562:x1875954691560320:12345-192.168.206.1@tcp:35:lfs.0 00000004:00010000:1.0:1789050061.335942:0:5821:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb04 expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050061.336187:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000001:00080000:1.0:1789050061.336264:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000001:00080000:1.0:1789050061.336566:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1789050061.336633:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.336648:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 49 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.336656:0:5821:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.336691:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 49 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.336705:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 49 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050061.336718:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875954704129152:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050061.336806:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050061.349741:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050061.350070:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560448 00000100:00100000:2.0:1789050061.350079:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560448 00010000:00010000:2.0:1789050061.350115:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 50 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050061.350164:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:2.0:1789050061.350175:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:2347:x1875954691560448:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050061.350188:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050061.350195:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 50 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.350239:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 50 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.350261:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:2.0:1789050061.350267:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.350291:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.350298:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.350316:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050061.350365:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+50:2347:x1875954691560448:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 192us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.350373:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 77 00010000:00010000:1.0:1789050061.351054:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b797e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fae1 expref: 49 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050061.351072:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875954704129152:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050061.351103:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.351128:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.351135:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050061.351333:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000001:00080000:1.0:1789050061.351538:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967498 00000100:00100000:1.0:1789050061.351666:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704129280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789050061.351819:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050061.351855:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789050061.352248:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129280 00000100:00100000:2.0:1789050061.352255:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129280 00000100:00100000:2.0:1789050061.352310:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050061.352319:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1875954704129280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050061.352384:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1875954704129280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 67us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.352392:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789050061.352451:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050061.353972:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704129280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789050061.354454:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000100:00100000:1.0:1789050061.354527:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704129408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789050061.354955:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050061.354985:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050061.355994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704129408 00000100:00100000:2.0:1789050061.356003:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704129408 00000100:00100000:2.0:1789050061.356055:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050061.356065:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1875954704129408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789050061.356296:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5821:x1875954704129408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 232us (1341us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789050061.356304:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789050061.356413:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cafe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875954704129408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789050061.356471:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00010000:00010000:0.0:1789050061.356517:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356531:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356539:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356566:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050061.356571:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356578:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356603:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:0.0:1789050061.356606:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789050061.356611:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.356617:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531400/0x9df728c939b7983c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050061.356785:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789050061.356924:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789050061.356936:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297344735516ns, next at 298344733049ns, rc = 0 00000001:00080000:0.0:1789050061.356942:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00010000:00010000:0.0:1789050061.356972:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff950714b52100) 00010000:00010000:0.0:1789050061.356975:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789050061.356981:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb04 expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050061.357074:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+52:11562:x1875954691560320:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 21190us (21458us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789050061.357082:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 56 00000020:00080000:0.0:1789050061.357086:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789050061.365667:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.365756:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560576 00000100:00100000:3.0:1789050061.365767:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560576 00000100:00100000:3.0:1789050061.365839:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 202 00000100:00100000:3.0:1789050061.365849:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+52:11562:x1875954691560576:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050061.365871:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050061.365893:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb0b expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.365949:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb0b expref: 53 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.365962:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb0b expref: 53 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.365981:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.365985:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050061.365988:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07600, rc 0) 00000100:00100000:3.0:1789050061.366047:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+53:11562:x1875954691560576:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 200us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050061.366054:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 202 00000100:00100000:2.0:1789050061.371776:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.371871:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560832 00000100:00100000:0.0:1789050061.371881:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560832 00000100:00100000:0.0:1789050061.371935:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:0.0:1789050061.371945:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+53:11562:x1875954691560832:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050061.372150:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+54:11562:x1875954691560832:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 207us (384us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789050061.372157:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:0.0:1789050061.478656:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.478992:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691560960 00000100:00100000:1.0:1789050061.479000:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691560960 00000100:00100000:1.0:1789050061.479113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 203 00000100:00100000:1.0:1789050061.479124:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:11572:x1875954691560960:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:1.0:1789050061.479219:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479236:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479248:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479274:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479282:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479288:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479368:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479376:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479383:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050061.479421:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479433:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479440:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479447:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479453:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050061.479457:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479470:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479482:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050061.479485:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050061.479490:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479505:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b7984a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479519:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479525:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479531:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479536:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050061.479539:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479545:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479551:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4b00) 00010000:00010000:1.0:1789050061.479553:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050061.479556:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479571:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479596:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479601:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479606:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479610:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050061.479613:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479618:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479625:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050061.479627:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050061.479630:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.479634:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79858 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050061.480061:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+54:11572:x1875954691560960:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 936us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.480069:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 203 00000100:00100000:3.0:1789050061.528826:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.529034:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691561216 00000100:00100000:0.0:1789050061.529043:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691561216 00000100:00100000:0.0:1789050061.529110:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 204 00000100:00100000:0.0:1789050061.529120:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+54:11575:x1875954691561216:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050061.529138:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050061.529157:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b7985f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb12 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529256:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529271:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529282:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529295:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529301:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529320:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529438:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79874 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529446:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529452:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050061.529462:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789050061.529549:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529557:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529564:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529570:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050061.529575:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529591:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529604:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:0.0:1789050061.529607:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050061.529618:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529625:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529638:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529644:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529649:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529654:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050061.529657:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529663:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529670:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950714b52100) 00010000:00010000:0.0:1789050061.529673:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050061.529676:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529681:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b7986d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529718:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b7985f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb12 expref: 57 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529743:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79874 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb12 expref: 56 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050061.529750:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:0.0:1789050061.529753:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050061.529755:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331600, rc 0) 00000100:00100000:0.0:1789050061.529817:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+56:11575:x1875954691561216:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 698us (999us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789050061.529824:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 204 00000100:00100000:2.0:1789050061.533973:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.534045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691561344 00000100:00100000:3.0:1789050061.534054:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691561344 00000100:00100000:3.0:1789050061.534112:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 205 00000100:00100000:3.0:1789050061.534121:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:11575:x1875954691561344:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:3.0:1789050061.534181:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534234:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534266:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534294:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534300:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534308:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534313:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050061.534317:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534324:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534336:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.534339:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050061.534344:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.534350:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.534416:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+56:11575:x1875954691561344:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 296us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050061.534424:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 205 00000100:00100000:3.0:1789050061.538079:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.538194:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691561600 00000100:00100000:0.0:1789050061.538228:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691561600 00000100:00100000:0.0:1789050061.538283:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:0.0:1789050061.538294:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+56:11575:x1875954691561600:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050061.538507:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+57:11575:x1875954691561600:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 215us (436us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789050061.538516:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:0.0:1789050061.654237:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.654557:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691561856 00000100:00100000:3.0:1789050061.654567:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691561856 00000100:00100000:3.0:1789050061.654637:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 206 00000100:00100000:3.0:1789050061.654646:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+57:11585:x1875954691561856:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050061.654680:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050061.654683:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789050061.654707:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34faf6 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.654725:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050061.654730:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050061.654742:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79889 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb19 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.654825:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.654837:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.654846:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050061.654856:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789050061.654971:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b79889 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb19 expref: 59 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.654986:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb19 expref: 58 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.655012:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.655014:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050061.655017:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07e00, rc 0) 00000100:00100000:3.0:1789050061.655078:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+58:11585:x1875954691561856:12345-192.168.206.1@tcp:101:bash.0 Request processed in 432us (901us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789050061.655085:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 206 00000100:00100000:2.0:1789050061.662126:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.662239:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562112 00000100:00100000:3.0:1789050061.662249:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562112 00000100:00100000:3.0:1789050061.662306:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 207 00000100:00100000:3.0:1789050061.662317:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+58:11585:x1875954691562112:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:3.0:1789050061.662368:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789050061.662393:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b79890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb19 expref: 58 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.662542:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79874 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb12 expref: 57 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.662554:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.662559:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050061.662785:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.662799:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.662810:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050061.662870:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967507 00000004:00010000:3.0:1789050061.662894:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000031f360a5 reply state 000000009246769e transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.662902:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050061.662991:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+59:11585:x1875954691562112:12345-192.168.206.1@tcp:36:bash.0 Request processed in 676us (873us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789050061.662998:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 207 00000020:00080000:3.0:1789050061.663003:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050061.667643:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:2.0:1789050061.667828:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667841:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667848:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667854:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050061.667859:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667866:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667887:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050061.667891:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050061.667905:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.667911:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b7989e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.667921:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562240 00000100:00100000:3.0:1789050061.667930:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562240 00000100:00100000:3.0:1789050061.667983:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 208 00000100:00100000:3.0:1789050061.667993:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+58:11585:x1875954691562240:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050061.668014:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050061.668029:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb20 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.668294:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.668306:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.668316:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050061.668345:0:8158:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789050061.668348:0:8158:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050061.668365:0:8158:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.668399:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 60 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.669358:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 59 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.669368:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.669371:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050061.669375:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06200, rc 0) 00000100:00100000:3.0:1789050061.669872:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+59:11585:x1875954691562240:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1876us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050061.669881:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 208 00000100:00100000:1.0:1789050061.681641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.682781:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562496 00000100:00100000:3.0:1789050061.682792:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562496 00000100:00100000:3.0:1789050061.682843:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:3.0:1789050061.682853:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+59:11585:x1875954691562496:12345-192.168.206.1@tcp:35:bash.0 00000100:00100000:3.0:1789050061.683072:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+60:11585:x1875954691562496:12345-192.168.206.1@tcp:35:bash.0 Request processed in 219us (1439us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789050061.683080:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:0.0:1789050061.764606:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.765103:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562624 00000100:00100000:1.0:1789050061.765114:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562624 00000100:00100000:1.0:1789050061.765287:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 209 00000100:00100000:1.0:1789050061.765300:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+60:11591:x1875954691562624:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050061.765324:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050061.765343:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b798b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb27 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765404:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765429:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765441:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050061.765473:0:5819:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789050061.765477:0:5819:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050061.765492:0:5819:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765515:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b798b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb27 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765533:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb27 expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.765556:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050061.765568:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050061.765573:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531000, rc 0) 00000100:00100000:1.0:1789050061.765646:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691562624:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 349us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.765789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 209 00000100:00100000:2.0:1789050061.769699:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.769976:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562752 00000100:00100000:1.0:1789050061.769985:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562752 00000100:00100000:1.0:1789050061.770037:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 210 00000100:00100000:1.0:1789050061.770047:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691562752:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050061.770065:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050061.770083:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b798c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb2e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770146:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770167:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770178:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770217:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770225:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770246:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770329:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770336:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770343:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050061.770373:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789050061.770377:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050061.770393:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.770403:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771014:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771020:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771027:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771032:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050061.771035:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771051:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771068:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050061.771071:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050061.771076:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771082:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b798c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771097:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771103:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771108:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771113:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050061.771116:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771122:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771128:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff950732cb4b00) 00010000:00010000:1.0:1789050061.771136:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050061.771139:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771154:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b798cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771191:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530a00/0x9df728c939b798c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb2e expref: 63 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771354:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb2e expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.771362:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050061.771365:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050061.771367:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530000, rc 0) 00000100:00100000:1.0:1789050061.771431:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:11591:x1875954691562752:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1384us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.771439:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 210 00000100:00100000:0.0:1789050061.778632:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050061.778679:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.778764:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691562880 00000100:00100000:1.0:1789050061.778774:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691562880 00000100:00100000:1.0:1789050061.778840:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:1.0:1789050061.778850:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+62:2347:x1875954691562880:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050061.778865:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050061.778887:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb2e expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.778906:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050061.778911:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050061.778968:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+61:2347:x1875954691562880:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.778988:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:3.0:1789050061.779185:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563136 00000100:00100000:3.0:1789050061.779190:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563136 00000100:00100000:3.0:1789050061.779399:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 211 00000100:00100000:3.0:1789050061.779408:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691563136:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050061.779424:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050061.779438:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.779529:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.779544:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 62 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.779552:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.779591:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 62 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.779603:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 62 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.779615:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607604380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704129536:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050061.779683:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050061.783719:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050061.783804:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563264 00000100:00100000:2.0:1789050061.783813:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563264 00010000:00010000:2.0:1789050061.783860:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 63 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050061.783906:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:2.0:1789050061.783916:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+63:2347:x1875954691563264:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050061.783942:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050061.783950:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 63 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.783961:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 63 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.783982:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050061.783987:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.783996:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.784003:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.784021:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050061.784073:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+63:2347:x1875954691563264:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 159us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.784080:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 78 00010000:00010000:3.0:1789050061.784734:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b798ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb20 expref: 62 pid: 8158 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050061.784752:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607604380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704129536:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050061.784773:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.784782:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.784802:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050061.784832:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789050061.784963:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 63 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.784978:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 62 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.784985:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050061.784988:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050061.784991:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07e00, rc 0) 00000100:00100000:3.0:1789050061.785033:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+62:11591:x1875954691563136:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 5626us (6353us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789050061.785039:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 211 00000100:00100000:0.0:1789050061.789257:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050061.789375:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563520 00000100:00100000:2.0:1789050061.789384:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563520 00000100:00100000:2.0:1789050061.789441:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050061.789451:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:11591:x1875954691563520:12345-192.168.206.1@tcp:103:lfs.0 00010000:00010000:2.0:1789050061.789465:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050061.789487:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b79843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb0b expref: 62 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050061.789523:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050061.789527:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050061.789577:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691563520:12345-192.168.206.1@tcp:103:lfs.0 Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050061.789594:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:0.0:1789050061.791680:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050061.791778:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563648 00000100:00100000:3.0:1789050061.791787:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563648 00000100:00100000:3.0:1789050061.791918:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 212 00000100:00100000:3.0:1789050061.791929:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691563648:12345-192.168.206.1@tcp:58:lfs.0 00010000:00010000:3.0:1789050061.792029:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.792043:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050061.792055:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050061.792288:0:8158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789050061.792372:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691563648:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 444us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050061.792379:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 212 00000100:00100000:0.0:1789050061.794753:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050061.794839:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563776 00000100:00100000:1.0:1789050061.794848:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563776 00000100:00100000:1.0:1789050061.794906:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 213 00000100:00100000:1.0:1789050061.794915:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+61:11591:x1875954691563776:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050061.794932:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050061.794949:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb3c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795000:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795011:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795029:0:5819:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795044:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795809:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050061.795814:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050061.795828:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050061.795838:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530000, rc 0) 00000100:00100000:1.0:1789050061.795897:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+62:11591:x1875954691563776:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 982us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050061.795904:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 213 00010000:00010000:0.0:1789050061.963924:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050062.091559:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050062.091570:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050062.091635:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:2.0:1789050062.091643:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789050062.091811:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704129664:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050062.091997:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c17a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050062.099674:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704129664:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789050062.100427:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.100524:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691563904 00000100:00100000:1.0:1789050062.100534:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691563904 00000100:00100000:1.0:1789050062.100612:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 214 00000100:00100000:1.0:1789050062.100624:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:11592:x1875954691563904:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789050062.100664:0:5817:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050062.100799:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:11592:x1875954691563904:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 177us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.100806:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 214 00000100:00100000:0.0:1789050062.106608:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.107377:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691564032 00000100:00100000:3.0:1789050062.107391:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691564032 00000100:00100000:3.0:1789050062.107471:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 215 00000100:00100000:3.0:1789050062.107484:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+62:11592:x1875954691564032:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789050062.107587:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107609:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107625:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107647:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107654:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107661:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107686:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107695:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107719:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050062.107768:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789050062.107772:0:5818:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050062.107799:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107811:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107818:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107825:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107832:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.107836:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.107845:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108157:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:3.0:1789050062.108161:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.108168:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108176:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06200/0x9df728c939b79900 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108254:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108262:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108268:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108274:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.108278:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108284:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108292:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9507114dce00) 00010000:00010000:3.0:1789050062.108295:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.108298:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108303:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79907 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108321:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108327:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108333:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108344:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.108347:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108353:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108362:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050062.108364:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.108376:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.108382:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7990e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.108472:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+62:11592:x1875954691564032:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 989us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.108481:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 215 00000100:00100000:0.0:1789050062.111670:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.111763:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691564288 00000100:00100000:1.0:1789050062.111775:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691564288 00000100:00100000:1.0:1789050062.111879:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 216 00000100:00100000:1.0:1789050062.111890:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+62:11592:x1875954691564288:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050062.111914:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050062.111935:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79915 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb43 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112048:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112065:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112077:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050062.112089:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789050062.112260:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112269:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112276:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112281:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050062.112285:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112294:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112306:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050062.112309:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050062.112314:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112321:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b7991c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112365:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79915 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb43 expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112374:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:1.0:1789050062.112376:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789050062.112380:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79915 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb43 expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.112401:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530600, rc 0) 00000100:00100000:1.0:1789050062.112460:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691564288:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 571us (803us total) trans 4294967511 rc 301/301 00000100:00100000:1.0:1789050062.112468:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 216 00000100:00100000:0.0:1789050062.125190:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.125429:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691564416 00000100:00100000:2.0:1789050062.125441:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691564416 00000100:00100000:2.0:1789050062.125516:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 217 00000100:00100000:2.0:1789050062.125528:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691564416:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789050062.125573:0:5819:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789050062.125711:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691564416:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 184us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.125719:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 217 00000100:00100000:0.0:1789050062.138131:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.138408:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691564672 00000100:00100000:3.0:1789050062.138422:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691564672 00000100:00100000:3.0:1789050062.138491:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 218 00000100:00100000:3.0:1789050062.138503:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691564672:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050062.138530:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050062.138533:0:8158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789050062.138565:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b798ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb27 expref: 63 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.138603:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050062.138627:0:8158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050062.138644:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7992a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb4a expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789050062.139146:0:8158:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789050062.139837:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.139855:0:8158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.139867:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.139928:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7992a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb4a expref: 65 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.139947:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb4a expref: 64 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.139956:0:8158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9507114dce00) 00010000:00010000:3.0:1789050062.139959:0:8158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050062.139962:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06000, rc 0) 00000100:00100000:3.0:1789050062.140040:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+64:11592:x1875954691564672:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1539us (1922us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789050062.140048:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 218 00000100:00100000:0.0:1789050062.146663:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.146761:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691564928 00000100:00100000:2.0:1789050062.146773:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691564928 00000100:00100000:2.0:1789050062.146841:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 219 00000100:00100000:2.0:1789050062.146851:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+64:11592:x1875954691564928:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050062.146940:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050062.146970:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b79931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb4a expref: 64 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.146991:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9507114dce00) 00010000:00010000:2.0:1789050062.147005:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050062.147030:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147045:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147056:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147069:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147076:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147082:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147340:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147348:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147354:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147368:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050062.147372:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147381:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147390:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050062.147393:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050062.147398:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147403:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b7993f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147415:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147421:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147428:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147433:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050062.147436:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147442:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147460:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1bfc89ee (ffff95072c9b1a00) 00010000:00010000:2.0:1789050062.147462:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050062.147466:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.147472:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79946 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1bfc89ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.147559:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691564928:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 708us (908us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050062.147567:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 219 00000100:00100000:0.0:1789050062.154007:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.154118:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691565056 00000100:00100000:1.0:1789050062.154130:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691565056 00000100:00100000:1.0:1789050062.154247:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 220 00000100:00100000:1.0:1789050062.154260:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+63:11592:x1875954691565056:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050062.154286:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050062.154317:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b7994d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb51 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154362:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154377:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154391:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154514:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b7994d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 65 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154539:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.154562:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:1.0:1789050062.154566:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050062.154570:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531200, rc 0) 00000100:00100000:1.0:1789050062.154646:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+64:11592:x1875954691565056:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 388us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.154653:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 220 00000100:00100000:0.0:1789050062.167562:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.167718:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691565312 00000100:00100000:3.0:1789050062.167733:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691565312 00000100:00100000:3.0:1789050062.167886:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 221 00000100:00100000:3.0:1789050062.167898:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+64:11592:x1875954691565312:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789050062.168013:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.168032:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.168045:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050062.168487:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1789050062.168499:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298156298962ns, next at 299156296112ns, rc = 0 00000004:00010000:3.0:1789050062.168614:0:5818:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c8e5fce8 reply state 00000000a4e7cc52 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.168624:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050062.168730:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+66:11592:x1875954691565312:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 834us (1182us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1789050062.168739:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 221 00010000:00010000:3.0:1789050062.174091:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.174126:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.174396:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691565440 00010000:00010000:3.0:1789050062.174403:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.174412:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691565440 00010000:00010000:3.0:1789050062.174413:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.174423:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.174428:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.174455:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.174473:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:3.0:1789050062.174478:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789050062.174483:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.174484:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 222 00010000:00010000:3.0:1789050062.174498:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07c00/0x9df728c939b7995b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.174505:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+66:11592:x1875954691565440:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050062.174537:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050062.174561:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb58 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.174642:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 66 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.174657:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 66 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.174675:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:2.0:1789050062.174678:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050062.174693:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050062.174762:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+66:11592:x1875954691565440:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 264us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.174770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 222 00000100:00100000:0.0:1789050062.186747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.186930:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691565568 00000100:00100000:2.0:1789050062.186939:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691565568 00000100:00080000:0.0:1789050062.187378:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050062.187930:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:2.0:1789050062.187945:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691565568:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789050062.188245:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691565568:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 305us (1506us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789050062.188254:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:2.0:1789050062.194600:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.194690:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691565824 00000100:00100000:3.0:1789050062.194701:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691565824 00000100:00100000:3.0:1789050062.194757:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:3.0:1789050062.194766:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+66:11592:x1875954691565824:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050062.195029:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+67:11592:x1875954691565824:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 263us (455us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789050062.195037:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:0.0:1789050062.208079:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.208448:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566080 00000100:00100000:2.0:1789050062.208459:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566080 00000100:00100000:2.0:1789050062.208561:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 223 00000100:00100000:2.0:1789050062.208571:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+67:11592:x1875954691566080:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789050062.208692:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+67:11592:x1875954691566080:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 122us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.208700:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 223 00000100:00100000:0.0:1789050062.215129:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.215325:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566208 00000100:00100000:1.0:1789050062.215335:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566208 00000100:00100000:1.0:1789050062.215392:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 224 00000100:00100000:1.0:1789050062.215402:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+67:11592:x1875954691566208:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789050062.215419:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050062.215437:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb5f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215498:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215511:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215522:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050062.215555:0:5817:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050062.215571:0:5817:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215608:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530600/0x9df728c939b79969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb5f expref: 69 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215637:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb5f expref: 68 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.215645:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:1.0:1789050062.215648:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789050062.215651:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531600, rc 0) 00000100:00100000:1.0:1789050062.215704:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+68:11592:x1875954691566208:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 304us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.215710:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 224 00000100:00100000:1.0:1789050062.218718:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.218784:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566336 00000100:00100000:3.0:1789050062.218792:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566336 00000100:00100000:3.0:1789050062.218845:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050062.218855:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+10:2347:x1875954691566336:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050062.218871:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050062.218899:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb66 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050062.218925:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb8dae553880, blocks: 0x1 00010000:00010000:3.0:1789050062.218955:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=298s v=(0 0) 00010000:00010000:3.0:1789050062.218959:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050062.218968:0:6670:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.218987:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.218999:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06200, rc 0) 00000100:00100000:3.0:1789050062.219041:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:2347:x1875954691566336:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 188us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.219048:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050062.225647:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.225751:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566592 00000100:00100000:0.0:1789050062.225760:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566592 00000100:00100000:0.0:1789050062.225854:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 225 00000100:00100000:0.0:1789050062.225864:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+68:11592:x1875954691566592:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789050062.225977:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+68:11592:x1875954691566592:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050062.225984:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 225 00000100:00100000:2.0:1789050062.232074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.232173:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566720 00000100:00100000:3.0:1789050062.232183:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566720 00000100:00100000:3.0:1789050062.232261:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:3.0:1789050062.232272:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+11:11592:x1875954691566720:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050062.232289:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050062.232305:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb6d expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.232335:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.232344:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050062.232349:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050062.232368:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.232402:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.232417:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.232432:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704129792:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050062.232517:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789050062.235345:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1875954704129792:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050062.235383:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.235404:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07c00, rc 0) 00000100:00100000:3.0:1789050062.235459:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+12:11592:x1875954691566720:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 3189us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.235467:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:3.0:1789050062.236797:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.237869:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566848 00000100:00100000:1.0:1789050062.237889:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566848 00010000:00010000:1.0:1789050062.237929:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.237971:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:1.0:1789050062.237981:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+12:2348:x1875954691566848:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050062.237993:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050062.238016:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.238028:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.238050:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79977 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb66 expref: 12 pid: 6670 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.238079:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050062.238083:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050062.238092:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.238102:0:5803:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.238139:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.238438:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5803:1875954704129920:192.168.206.1@tcp:105: 00000100:00100000:1.0:1789050062.238520:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff95060597e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789050062.243681:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5803:1875954704129920:192.168.206.1@tcp:105: 00010000:00010000:1.0:1789050062.243708:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050062.243760:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+11:2348:x1875954691566848:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 5780us (6967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.243770:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:3.0:1789050062.249315:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.249453:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691566976 00000100:00100000:0.0:1789050062.249463:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691566976 00002000:00100000:0.0:1789050062.249508:0:6676:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff950607607100 x1875954691566976/t0(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:563/0 lens 504/0 e 0 to 0 dl 1789050073 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050062.249519:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950607607100 with x1875954691566976 ext(0->12) 00002000:00010000:0.0:1789050062.249525:0:6676:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff950607607100 00000100:00100000:0.0:1789050062.249554:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050062.249590:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+11:2347:x1875954691566976:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789050062.250971:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2c118c85-b079-4c51-87ec-099389ee7be3+13:2347:x1875954691566976:12345-192.168.206.1@tcp:4:lhsmtool_posix.0 Request processed in 1390us (1659us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789050062.250981:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00002000:00100000:0.0:1789050062.250991:0:6676:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff950607607100 x1875954691566976/t4294967320(0) o4->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:563/0 lens 504/448 e 0 to 0 dl 1789050073 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789050062.251000:0:6676:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff950607607100 with x1875954691566976 ext(0->12) 00002000:00010000:0.0:1789050062.251005:0:6676:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff950607607100 00000100:00100000:3.0:1789050062.258796:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.258901:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691567104 00000100:00100000:0.0:1789050062.258910:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691567104 00000100:00100000:0.0:1789050062.259031:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 226 00000100:00100000:0.0:1789050062.259041:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+68:11592:x1875954691567104:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789050062.327493:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1789050062.327512:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1789050062.327559:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000020:00080000:2.0:1789050062.327569:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95060597e840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789050062.327574:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c1b1900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95060597ecc0 00000020:00080000:2.0:1789050062.327587:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c1b1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c4a1000 00000020:00080000:2.0:1789050062.327647:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1789050062.327672:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000004:00080000:2.0:1789050062.327678:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789050062.327700:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789050062.327717:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff950728e0f600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789050062.327721:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c8d6400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950728e0f000 00000020:00080000:2.0:1789050062.327724:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95073c8d6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073dcc9c00 00000100:00100000:2.0:1789050062.328037:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789050062.328055:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704130048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789050062.328112:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050062.328296:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704130176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789050062.328322:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789050062.328361:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789050062.328517:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789050062.328626:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+20:11592:x1875954691567104:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 69584us (69837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.328635:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 226 00000100:00100000:0.0:1789050062.328708:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130048 00000100:00100000:0.0:1789050062.328715:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130048 00000100:00100000:0.0:1789050062.328760:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130176 00000100:00100000:0.0:1789050062.328763:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130176 00000100:00100000:0.0:1789050062.328783:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789050062.328791:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704130048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789050062.328824:0:6672:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1789050062.328845:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.328864:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.328873:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789050062.328898:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050062.328903:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.328929:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.328942:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 12 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.328954:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704130304:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050062.328991:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec300 going to sleep for 11 seconds 00000100:00080000:2.0:1789050062.329269:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050062.329284:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789050062.329292:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875954704130176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789050062.329401:0:8215:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789050062.329405:0:8215:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789050063011954349 00002000:00010000:2.0:1789050062.329407:0:8215:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789050062.329409:0:8215:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789050062930000000 -> 1789050063011954349 00002000:00010000:2.0:1789050062.329412:0:8215:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789050062.329455:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3282:x1875954704130176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (1132us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789050062.329468:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1789050062.329637:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff950604c66a00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789050062.329644:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704130176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050062.331965:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704130432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789050062.332017:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050062.332565:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130432 00000100:00100000:1.0:1789050062.332573:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130432 00000100:00100000:1.0:1789050062.332770:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789050062.332782:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704130432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789050062.332936:0:8215:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789050062.332969:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb8d7067147d, atime: 0x18d3fb8d7b227fa6, ctime: 0x18d3fb8d7067147d, blocks: 0x1 00010000:00010000:1.0:1789050062.332989:0:8215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.333003:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789050062.333008:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050062.333014:0:8215:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.333030:0:8215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.333040:0:8215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.333048:0:8215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.333108:0:8215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789050062.334474:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1875954704130432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1692us (2452us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789050062.334484:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1789050062.335320:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff950604c67480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789050062.335329:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704130432:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789050062.336109:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050062.336119:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.336131:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050062.336135:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.336146:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.336176:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.336184:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a71be1/0x9df728c939b7998c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.336222:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050062.336224:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050062.336226:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050062.339665:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.339735:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.339823:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691567360 00000100:00100000:3.0:1789050062.339844:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691567360 00010000:00010000:3.0:1789050062.339877:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 13 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.339920:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:3.0:1789050062.339930:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+13:2347:x1875954691567360:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050062.339944:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050062.339950:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 13 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.339964:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 13 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.339988:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050062.339992:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789050062.339998:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.340008:0:5802:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.340028:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050062.340075:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+13:2347:x1875954691567360:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.340083:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 80 00010000:00010000:1.0:1789050062.340553:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b45f62/0x9df728c939b79747 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34facc expref: 12 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.340570:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704130304:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050062.340599:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.340619:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.340636:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.340646:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.340653:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.340676:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050062.340920:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050062.340927:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.340935:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050062.340939:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.340960:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.340974:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.340981:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b79985 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.341003:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050062.341005:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050062.341007:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050062.341439:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3284:x1875954704130048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12647us (13325us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789050062.341447:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789050062.341466:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691567232 00000100:00100000:1.0:1789050062.341470:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691567232 00000004:00080000:3.0:1789050062.341681:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff950604c67b80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789050062.341688:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704130048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789050062.342748:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:2.0:1789050062.342763:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+12:2348:x1875954691567232:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789050062.430133:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+12:2348:x1875954691567232:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 87366us (90469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.430144:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 69 00000001:00080000:3.0:1789050062.430304:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1789050062.430318:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1789050062.437288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.437428:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691567616 00000100:00100000:1.0:1789050062.437437:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691567616 00000100:00100000:1.0:1789050062.437502:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 227 00000100:00100000:1.0:1789050062.437512:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+20:11592:x1875954691567616:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050062.437561:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050062.437596:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b79970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb5f expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.437645:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:1.0:1789050062.437651:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050062.437678:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.437691:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.437701:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050062.437914:0:5817:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007067046f reply state 00000000859e940d transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.437924:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050062.438014:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+21:11592:x1875954691567616:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 503us (735us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789050062.438022:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 227 00000100:00100000:0.0:1789050062.445778:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.446236:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691567744 00000100:00100000:1.0:1789050062.446245:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691567744 00000100:00100000:1.0:1789050062.446297:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 70 00000100:00100000:1.0:1789050062.446307:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2347:x1875954691567744:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789050062.446554:0:8215:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789050062.446557:0:8215:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789050063011954349 -> 1789050062429000000 00002000:00010000:1.0:1789050062.446560:0:8215:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789050062068000000 00002000:00010000:1.0:1789050062.446562:0:8215:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789050063011954349 -> 1789050062429000000 00002000:00010000:1.0:1789050062.446564:0:8215:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789050062.446652:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691567744:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 346us (882us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789050062.446660:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 70 00010000:00010000:2.0:1789050062.447372:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447396:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447404:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447411:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050062.447416:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447424:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447448:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:2.0:1789050062.447452:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050062.447457:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.447464:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b79993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.454088:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.454192:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568000 00000100:00100000:2.0:1789050062.454229:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568000 00000100:00100000:2.0:1789050062.454279:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 228 00000100:00100000:2.0:1789050062.454289:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:11592:x1875954691568000:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789050062.454358:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.454374:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.454400:0:5819:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.454432:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.454443:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 20 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.454456:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704130560:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050062.454526:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050062.461738:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875954704130560:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050062.461765:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.464431:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.464548:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568128 00000100:00100000:1.0:1789050062.464557:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568128 00010000:00010000:1.0:1789050062.464604:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.464652:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:1.0:1789050062.464663:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+21:2348:x1875954691568128:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050062.464677:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050062.464684:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464696:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464716:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531200/0x9df728c939b79954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb51 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464732:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:1.0:1789050062.464736:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464744:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464752:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.464797:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050062.464845:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+20:2348:x1875954691568128:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 184us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.464853:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 81 00010000:00010000:3.0:1789050062.465236:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465244:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465272:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465279:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465285:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465291:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.465295:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465302:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465311:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:3.0:1789050062.465314:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789050062.465325:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.465332:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7999a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.465386:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:11592:x1875954691568000:12345-192.168.206.1@tcp:55:lhsmtool_posix.0 Request processed in 11098us (11305us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789050062.465394:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 228 00000100:00100000:1.0:1789050062.469302:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.469380:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568256 00000100:00100000:0.0:1789050062.469390:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568256 00000100:00100000:0.0:1789050062.469436:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:0.0:1789050062.469445:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691568256:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789050062.469483:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.469501:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.469510:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050062.469526:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050062.469532:0:6672:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.469565:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.469588:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 8 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.469604:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704130688:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050062.469690:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050062.471401:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1875954704130688:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050062.471424:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.473538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.473792:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568384 00000100:00100000:0.0:1789050062.473800:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568384 00010000:00010000:0.0:1789050062.473836:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 9 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.473876:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:0.0:1789050062.473885:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+9:2347:x1875954691568384:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050062.473900:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050062.473921:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 9 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.473952:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 9 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.473973:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b7997e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb6d expref: 9 pid: 6671 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.473989:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050062.473994:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050062.474000:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.474014:0:5801:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.474049:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050062.474093:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.474105:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691568384:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 219us (573us total) trans 0 rc 0/0 00010000:00010000:2.0:1789050062.474107:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.474120:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 82 00010000:00010000:2.0:1789050062.474138:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474149:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474169:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474176:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050062.474180:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474189:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474235:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.474245:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b799a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.474998:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691568256:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 5550us (5703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.475006:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 71 00000100:00100000:0.0:1789050062.475729:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050062.475744:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704130816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050062.475791:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050062.475863:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704130816 00000100:00100000:1.0:1789050062.475869:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704130816 00000100:00100000:1.0:1789050062.475920:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050062.475928:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704130816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050062.475946:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789050062.475990:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704130816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.475997:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789050062.476062:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789050062.476068:0:3285:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1789050062.476085:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff950604c66a00, transno 4294967321 00000004:00080000:0.0:1789050062.476101:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff950604c67b80, transno 4294967322 00000100:00100000:0.0:1789050062.476123:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704130816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050062.483588:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050062.483697:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568640 00000100:00100000:2.0:1789050062.483706:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568640 00000100:00100000:2.0:1789050062.483748:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 229 00000100:00100000:2.0:1789050062.483756:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:11592:x1875954691568640:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050062.483823:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.483849:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.483861:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.484060:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.484072:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.484081:0:5817:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.484113:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.484126:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 20 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.484139:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704130944:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050062.484246:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050062.487178:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704130944:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050062.487228:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.497997:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.498136:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568768 00000100:00100000:0.0:1789050062.498145:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568768 00010000:00010000:0.0:1789050062.498197:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.498269:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 83 00000100:00100000:0.0:1789050062.498279:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:2348:x1875954691568768:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050062.498293:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050062.498300:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498314:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498335:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb58 expref: 21 pid: 5817 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498350:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:0.0:1789050062.498356:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498365:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498371:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.498401:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050062.498445:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.498464:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.498464:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:2348:x1875954691568768:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 184us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050062.498481:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 83 00000001:00080000:2.0:1789050062.498643:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00000001:00080000:2.0:1789050062.498774:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00000001:00080000:2.0:1789050062.498809:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967518 00000100:00100000:2.0:1789050062.498867:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5817:1875954704131072:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789050062.498905:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050062.499066:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050062.507851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131072 00000100:00100000:3.0:1789050062.507865:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131072 00000100:00100000:3.0:1789050062.507930:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050062.507940:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875954704131072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789050062.508058:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875954704131072:12345-0@lo:1000:mdt00_000.0 Request processed in 119us (9151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.508066:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050062.508416:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5817:1875954704131072:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789050062.508891:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967519 00000100:00100000:2.0:1789050062.508965:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5817:1875954704131200:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789050062.509006:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050062.509037:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050062.510461:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131200 00000100:00100000:3.0:1789050062.510471:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131200 00000100:00100000:3.0:1789050062.510526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789050062.510535:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875954704131200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789050062.510782:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5817:x1875954704131200:12345-0@lo:1000:mdt00_000.0 Request processed in 247us (1776us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789050062.510790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050062.510867:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5817:1875954704131200:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789050062.510906:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510917:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510925:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510930:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050062.510933:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510955:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510968:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950732cb4b00) 00010000:00010000:2.0:1789050062.510971:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050062.510976:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.510981:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51e00/0x9df728c939b799af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511009:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511014:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511020:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511025:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050062.511028:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511034:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511040:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050062.511042:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050062.511047:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511068:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.511077:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050062.512153:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.512170:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c65500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704131328:192.168.206.1@tcp:105: 00000100:00100000:2.0:1789050062.512362:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050062.517753:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c65500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875954704131328:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050062.517781:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517792:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b798f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517831:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517844:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517855:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517864:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517870:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517877:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517883:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.517886:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517893:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517903:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050062.517906:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.517909:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517915:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517931:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517937:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517943:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517948:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.517951:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517958:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517966:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050062.517969:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050062.517971:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.517976:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50200/0x9df728c939b799a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050062.518426:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050062.518430:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050062.518957:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1789050062.518965:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050062.519112:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:11592:x1875954691568640:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 35352us (35537us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789050062.519123:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 229 00000020:00080000:3.0:1789050062.519128:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789050062.528370:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.529566:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691568896 00000100:00100000:3.0:1789050062.529586:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691568896 00000100:00100000:3.0:1789050062.529706:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:3.0:1789050062.529715:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:11591:x1875954691568896:12345-192.168.206.1@tcp:49:lfs.0 00000100:00100000:3.0:1789050062.529836:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+23:11591:x1875954691568896:12345-192.168.206.1@tcp:49:lfs.0 Request processed in 122us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.529843:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:1.0:1789050062.540380:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.540465:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050062.540542:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691569152 00000100:00100000:0.0:1789050062.540551:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691569152 00000100:00100000:0.0:1789050062.540608:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:0.0:1789050062.540618:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+23:11592:x1875954691569152:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050062.541255:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1789050062.541357:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691569408 00000001:00080000:0.0:1789050062.541358:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967521 00000100:00100000:2.0:1789050062.541363:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691569408 00010000:00010000:0.0:1789050062.541400:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.541408:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 230 00010000:00010000:0.0:1789050062.541415:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050062.541416:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+26:11591:x1875954691569408:12345-192.168.206.1@tcp:58:lfs.0 00010000:00010000:0.0:1789050062.541427:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541436:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541442:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541446:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541461:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050062.541537:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:11592:x1875954691569152:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 919us (1165us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789050062.541545:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 62 00000040:00080000:2.0:1789050062.541556:0:8158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000020:00080000:0.0:1789050062.541557:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050062.541606:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+25:11591:x1875954691569408:12345-192.168.206.1@tcp:58:lfs.0 Request processed in 190us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050062.541613:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 230 00010000:00010000:0.0:1789050062.541613:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050062.541618:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541625:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050062.541628:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541636:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541647:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff950714b52b00) 00010000:00010000:0.0:1789050062.541650:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789050062.541654:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541659:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330a00/0x9df728c939b799bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050062.541672:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050062.541674:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050062.541676:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050062.607455:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050062.607560:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691569536 00000100:00100000:3.0:1789050062.607570:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691569536 00000100:00100000:3.0:1789050062.607636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 231 00000100:00100000:3.0:1789050062.607646:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+25:11594:x1875954691569536:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050062.607672:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050062.607693:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb74 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607767:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607781:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607793:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607808:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607815:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.607822:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.608061:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.608073:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.608082:0:5818:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.608128:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.608143:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 26 pid: 5818 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050062.608168:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704131456:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050062.608305:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050062.616024:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875954704131456:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050062.616053:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050062.616184:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.616408:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691569792 00000100:00100000:1.0:1789050062.616415:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691569792 00000100:00100000:1.0:1789050062.616470:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:1.0:1789050062.616481:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+27:5589:x1875954691569792:12345-192.168.206.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789050062.616736:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+28:5589:x1875954691569792:12345-192.168.206.1@tcp:35:ldlm_bl.0 Request processed in 258us (557us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789050062.616744:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:2.0:1789050062.624684:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050062.627739:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691569920 00000100:00100000:1.0:1789050062.627771:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691569920 00010000:00010000:1.0:1789050062.627820:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 28 pid: 5818 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050062.627869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:1.0:1789050062.627881:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+28:2348:x1875954691569920:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050062.627896:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050062.627903:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 28 pid: 5818 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.627917:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 28 pid: 5818 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.627938:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07e00/0x9df728c939b798e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb35 expref: 28 pid: 5818 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.627957:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050062.627962:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.627972:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.627980:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050062.628014:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050062.628066:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c118c85-b079-4c51-87ec-099389ee7be3+27:2348:x1875954691569920:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 187us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050062.628083:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 84 00010000:00010000:3.0:1789050062.628172:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628180:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050062.628249:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789050062.628260:0:5818:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050062.628282:0:5818:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628295:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628305:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628311:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628318:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628323:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.628327:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628335:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628343:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050062.628346:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.628349:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628355:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b799cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628365:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628381:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628386:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628391:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050062.628394:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628400:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628407:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9507114dc700) 00010000:00010000:3.0:1789050062.628409:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050062.628412:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628418:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07600/0x9df728c939b799d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628455:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06000/0x9df728c939b799c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb74 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628469:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb74 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050062.628476:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050062.628478:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050062.628498:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06400, rc 0) 00000100:00100000:3.0:1789050062.628526:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+26:11594:x1875954691569536:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 20882us (21081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050062.628533:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 231 00010000:00010000:0.0:1789050062.987418:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050063.566093:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050063.566102:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050063.566306:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789050063.566314:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789050063.566427:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704131584:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789050063.566516:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507061b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050063.570367:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050063.570402:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691570048 00000100:00100000:3.0:1789050063.570410:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691570048 00000100:00100000:3.0:1789050063.570457:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 232 00000100:00100000:3.0:1789050063.570466:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+27:11605:x1875954691570048:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050063.570497:0:8158:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789050063.570534:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875954704131584:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789050063.570605:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+26:11605:x1875954691570048:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 138us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050063.570614:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 232 00000100:00080000:3.0:1789050063.570637:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789050063.586039:0:12545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050063.586054:0:12545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050063.586107:0:12545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789050063.586112:0:12545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789050063.588310:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050063.588338:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691570304 00000100:00100000:0.0:1789050063.588346:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691570304 00000100:00100000:0.0:1789050063.588394:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 233 00000100:00100000:0.0:1789050063.588403:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+26:11605:x1875954691570304:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050063.588431:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050063.588449:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b799e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb7b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050063.588533:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b799e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050063.588547:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b799e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050063.588561:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b799e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050063.588582:0:5817:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789050063.588707:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b799e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb7b expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050063.588723:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b799e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb7b expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050063.588732:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:0.0:1789050063.588735:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050063.588739:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331000, rc 0) 00000100:00100000:0.0:1789050063.588788:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+28:11605:x1875954691570304:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 385us (484us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789050063.588794:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 233 00000100:00100000:1.0:1789050063.596746:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050063.596776:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691570560 00000100:00100000:1.0:1789050063.596784:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691570560 00000100:00100000:1.0:1789050063.596832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 234 00000100:00100000:1.0:1789050063.596842:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+28:11605:x1875954691570560:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789050063.596921:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.596938:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.596948:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597118:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597126:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597142:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597149:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050063.597165:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597172:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597183:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:1.0:1789050063.597185:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050063.597190:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050063.597195:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531600/0x9df728c939b799f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050063.599715:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+29:11605:x1875954691570560:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 2866us (2968us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789050063.599728:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 234 00000040:00080000:1.0:1789050063.599861:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050063.599865:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050063.600482:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789050063.600493:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050063.619018:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050063.619152:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050063.619183:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691570944 00000100:00100000:3.0:1789050063.619191:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691570944 00000100:00100000:3.0:1789050063.619262:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050063.619272:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:11605:x1875954691570944:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789050063.619492:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+30:11605:x1875954691570944:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 220us (343us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789050063.619500:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:2.0:1789050063.623682:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691570688 00000100:00100000:2.0:1789050063.623695:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691570688 00000100:00100000:2.0:1789050063.623759:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:2.0:1789050063.623769:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+30:2348:x1875954691570688:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050063.623784:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050063.623810:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331000/0x9df728c939b799e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb7b expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050063.623826:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050063.623831:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050063.623962:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:2348:x1875954691570688:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 193us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050063.623969:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00010000:00010000:0.0:1789050064.012758:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789050064.065978:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789050064.065995:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789050064.523462:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704131840:0@lo:400:kworker.0 00000100:00100000:3.0:1789050064.523509:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704131968:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.523529:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050064.523578:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050064.523604:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704132352:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.523634:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050064.523642:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131840 00000100:00100000:3.0:1789050064.523662:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131840 00000100:00100000:3.0:1789050064.523708:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789050064.523717:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704131840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.523736:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131968 00000100:00100000:2.0:1789050064.523742:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131968 00000100:00100000:3.0:1789050064.523777:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704131840:12345-0@lo:400:kworker.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050064.523784:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789050064.523867:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704131712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050064.523909:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050064.523932:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704132224:0@lo:400:kworker.0 00000100:00100000:0.0:1789050064.523954:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050064.523967:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050064.523973:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950607604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704132096:0@lo:400:kworker.0 00000100:00100000:0.0:1789050064.523992:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050064.524176:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132352 00000100:00100000:1.0:1789050064.524181:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132352 00000100:00100000:1.0:1789050064.524225:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132096 00000100:00100000:1.0:1789050064.524229:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132096 00000100:00100000:1.0:1789050064.524250:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789050064.524266:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704132352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.524301:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704132352:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.524308:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789050064.524324:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789050064.524330:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704132096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050064.524401:0:8158:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789050064.524409:0:8158:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789050064.524421:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789050064.524427:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132224 00000100:00100000:0.0:1789050064.524430:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132224 00000100:00100000:2.0:1789050064.525389:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.525452:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704131968:12345-0@lo:400:kworker.0 Request processed in 1660us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.526544:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704132096:12345-0@lo:400:kworker.0 Request processed in 2199us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.526563:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789050064.526614:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704131712 00000100:00100000:1.0:1789050064.526621:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704131712 00000100:00100000:1.0:1789050064.526657:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789050064.526665:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704131712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.526707:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704131712:12345-0@lo:400:kworker.0 Request processed in 43us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050064.526713:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789050064.526771:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704132096:0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.526783:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704131712:0@lo:400:kworker.0 00000100:00080000:1.0:1789050064.527345:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050064.527351:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050064.527354:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050064.527376:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789050064.527382:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c272680, transno 4294967307 00000004:00080000:1.0:1789050064.527392:0:3282:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789050064.527409:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff950604c67480, transno 4294967310 00000100:00100000:1.0:1789050064.527414:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704132352:0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.527438:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704131840:0@lo:400:kworker.0 00000100:00100000:1.0:1789050064.527907:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704131968:0@lo:400:kworker.0 00000100:00100000:3.0:1789050064.529194:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789050064.535706:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789050064.535728:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704132224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050064.535829:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704132224:12345-0@lo:400:kworker.0 Request processed in 112us (11874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050064.535837:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789050064.536862:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950607605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704132224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050064.543348:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:0.0:1789050065.035399:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050065.038140:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050065.038160:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050065.038268:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050065.038425:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132480 00000100:00100000:2.0:1789050065.038432:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132480 00000100:00100000:2.0:1789050065.038475:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789050065.038483:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704132480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050065.038513:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050065.038558:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704132480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.038576:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789050065.038624:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704132480:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789050065.541811:0:12599:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050065.541836:0:12599:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050065.541894:0:12599:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789050065.541902:0:12599:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789050065.613764:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050065.613808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050065.613836:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050065.613878:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050065.613902:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050065.613926:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571328 00000100:00100000:3.0:1789050065.613934:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571328 00000100:00100000:3.0:1789050065.613982:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571456 00000100:00100000:3.0:1789050065.613985:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571456 00000100:00100000:3.0:1789050065.614008:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:3.0:1789050065.614018:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691571328:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050065.614081:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2350:x1875954691571328:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.614088:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:3.0:1789050065.614105:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:3.0:1789050065.614111:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691571456:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.614287:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571072 00000100:00100000:2.0:1789050065.614292:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571072 00000100:00100000:2.0:1789050065.614320:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 287 00000100:00100000:2.0:1789050065.614327:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2350:x1875954691571072:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050065.614357:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2350:x1875954691571072:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.614363:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 287 00000100:00100000:3.0:1789050065.614449:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+5:2350:x1875954691571456:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 337us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.614456:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:3.0:1789050065.614476:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571584 00000100:00100000:3.0:1789050065.614480:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571584 00000100:00100000:3.0:1789050065.614515:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571200 00000100:00100000:3.0:1789050065.614518:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571200 00000100:00100000:3.0:1789050065.614541:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 137 00000100:00100000:3.0:1789050065.614548:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691571584:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050065.614587:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2350:x1875954691571584:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.614594:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 137 00000100:00100000:3.0:1789050065.614606:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 138 00000100:00100000:3.0:1789050065.614612:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+29:2350:x1875954691571200:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050065.614639:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c118c85-b079-4c51-87ec-099389ee7be3+29:2350:x1875954691571200:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050065.614644:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 138 00000100:00080000:2.0:1789050065.615249:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050065.615255:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050065.615257:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050065.709389:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050065.709492:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571840 00000100:00100000:2.0:1789050065.709510:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571840 00000100:00100000:2.0:1789050065.709592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 235 00000100:00100000:2.0:1789050065.709604:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+29:11627:x1875954691571840:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050065.709623:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050065.709641:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b799fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb82 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.709752:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79a03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.709767:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79a03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.709778:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79a03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050065.709790:0:5818:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789050065.709905:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b799fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb82 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.709924:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79a03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb82 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.709932:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050065.709935:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789050065.709939:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050065.710010:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c118c85-b079-4c51-87ec-099389ee7be3+31:11627:x1875954691571840:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 409us (636us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789050065.710017:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 235 00000100:00100000:3.0:1789050065.713778:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050065.713857:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691571968 00000100:00100000:2.0:1789050065.713874:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691571968 00000100:00100000:2.0:1789050065.713947:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 236 00000100:00100000:2.0:1789050065.713958:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+31:11627:x1875954691571968:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050065.714025:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714052:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714065:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714092:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714099:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714106:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714112:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050065.714116:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714124:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714137:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:2.0:1789050065.714141:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050065.714146:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050065.714153:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050065.714522:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+31:11627:x1875954691571968:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 564us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050065.714538:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 236 00000100:00100000:3.0:1789050065.777350:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050065.777500:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572096 00000100:00100000:1.0:1789050065.777515:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572096 00000100:00100000:1.0:1789050065.777596:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:1.0:1789050065.777608:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691572096:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:1.0:1789050065.777624:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050065.777645:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb3cb05/0x9df728c939b79a18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb89 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789050065.777673:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x18d3fb8d90789140, atime: 0x18d3fb8d7af42500, ctime: 0x18d3fb8d90789140, blocks: 0xb 00010000:00010000:1.0:1789050065.777692:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1789050065.777696:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050065.777706:0:6671:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb3cb05/0x9df728c939b79a18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb89 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.777722:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eb3cb05/0x9df728c939b79a18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb89 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050065.777735:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530a00, rc 0) 00000100:00100000:1.0:1789050065.777812:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+8:2348:x1875954691572096:12345-192.168.206.1@tcp:101:cat.0 Request processed in 206us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050065.777821:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 72 00000100:00100000:3.0:1789050065.781318:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050065.781426:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572224 00000100:00100000:2.0:1789050065.781439:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572224 00002000:00100000:2.0:1789050065.781499:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff95073f424380 x1875954691572224/t0(0) o3->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:566/0 lens 488/0 e 0 to 0 dl 1789050076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050065.781511:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073f424380 with x1875954691572224 ext(0->4095) 00002000:00010000:2.0:1789050065.781518:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073f424380 00000100:00100000:2.0:1789050065.781552:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050065.781572:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691572224:12345-192.168.206.1@tcp:3:cat.0 00000100:00100000:2.0:1789050065.781962:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2c118c85-b079-4c51-87ec-099389ee7be3+8:2347:x1875954691572224:12345-192.168.206.1@tcp:3:cat.0 Request processed in 391us (654us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789050065.781971:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00002000:00100000:2.0:1789050065.781979:0:6678:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff95073f424380 x1875954691572224/t0(0) o3->2c118c85-b079-4c51-87ec-099389ee7be3@192.168.206.1@tcp:566/0 lens 488/4536 e 0 to 0 dl 1789050076 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789050065.781988:0:6678:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073f424380 with x1875954691572224 ext(0->4095) 00002000:00010000:2.0:1789050065.781992:0:6678:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95073f424380 00010000:00010000:0.0:1789050066.062304:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050067.085646:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050067.598835:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050067.598855:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704132608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050067.598917:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050067.599052:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132608 00000100:00100000:2.0:1789050067.599060:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132608 00000100:00100000:2.0:1789050067.599112:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050067.599121:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704132608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050067.599164:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050067.599224:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950702d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875954704132608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050067.599241:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789050067.599272:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050067.599306:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704132608:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789050067.671807:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00080000:3.0:1789050067.671836:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00080000:3.0:1789050067.671850:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00080000:3.0:1789050067.671860:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff950703288300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789050067.671864:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950703479f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950703288180 00000020:00080000:3.0:1789050067.671867:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950703479800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c041c00 00000020:00080000:3.0:1789050067.671888:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789050067.672218:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789050067.672438:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789050067.708156:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1789050067.708173:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1789050068.109023:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050069.132417:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050069.645009:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704132736:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.645100:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050069.645222:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132736 00000100:00100000:3.0:1789050069.645232:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132736 00000100:00100000:3.0:1789050069.645288:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789050069.645298:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050069.646082:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704132736:12345-0@lo:400:kworker.0 Request processed in 782us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050069.646093:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789050069.646222:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704132736:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.646243:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050069.646252:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704133120:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.646294:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.646660:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704133248:0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.646694:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.646772:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704132864:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.646805:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.646826:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704133376:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.646871:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050069.647152:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133248 00000100:00100000:2.0:1789050069.647160:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133248 00000100:00100000:2.0:1789050069.647244:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132864 00000100:00100000:2.0:1789050069.647248:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132864 00000100:00100000:2.0:1789050069.647276:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789050069.647286:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.647343:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704133248:12345-0@lo:400:kworker.0 Request processed in 58us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.647350:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789050069.647369:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789050069.647376:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.647409:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704132864:12345-0@lo:400:kworker.0 Request processed in 34us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.647417:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789050069.647447:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050069.647478:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704133248:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.647724:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704132864:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.647735:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050069.647743:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704132992:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.647771:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050069.647807:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704132992 00000100:00100000:0.0:1789050069.647811:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704132992 00000100:00100000:0.0:1789050069.648024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789050069.648034:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704132992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.648076:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704132992:12345-0@lo:400:kworker.0 Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050069.648083:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789050069.648136:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133120 00000100:00100000:3.0:1789050069.648142:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133120 00000100:00100000:2.0:1789050069.648292:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133376 00000100:00100000:2.0:1789050069.648295:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133376 00000100:00100000:2.0:1789050069.648327:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789050069.648336:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704133120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050069.648346:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789050069.648359:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704133376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050069.648382:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704133120:12345-0@lo:400:kworker.0 Request processed in 47us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050069.648390:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789050069.648417:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704133376:12345-0@lo:400:kworker.0 Request processed in 61us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050069.648426:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789050069.648428:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789050069.648436:0:3285:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789050069.648458:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704133120:0@lo:400:kworker.0 00000100:00080000:0.0:1789050069.648593:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050069.648597:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050069.648600:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050069.648621:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704132992:0@lo:400:kworker.0 00000100:00100000:0.0:1789050069.648632:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704133376:0@lo:400:kworker.0 00000100:00100000:1.0:1789050070.156429:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050070.156466:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704133504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050070.156684:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050070.156792:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133504 00000100:00100000:2.0:1789050070.156803:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133504 00000100:00100000:2.0:1789050070.156871:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789050070.156883:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704133504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050070.156929:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050070.156981:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704133504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.156989:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789050070.157144:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704133504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050070.157382:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050070.431960:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050070.432147:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572352 00000100:00100000:3.0:1789050070.432159:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572352 00000100:00100000:3.0:1789050070.432276:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 237 00000100:00100000:3.0:1789050070.432288:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2c118c85-b079-4c51-87ec-099389ee7be3+18:11280:x1875954691572352:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789050070.432418:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2c118c85-b079-4c51-87ec-099389ee7be3+18:11280:x1875954691572352:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 Request processed in 132us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050070.432426:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 237 00000100:00080000:2.0:1789050070.432560:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050070.438355:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050070.438496:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572608 00000100:00100000:1.0:1789050070.438510:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572608 00000100:00100000:1.0:1789050070.438589:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:1.0:1789050070.438601:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+18:11280:x1875954691572608:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789050070.439035:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c118c85-b079-4c51-87ec-099389ee7be3+19:11280:x1875954691572608:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 434us (692us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789050070.439045:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:1.0:1789050070.730377:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050070.730503:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050070.730570:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050070.730679:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050070.730741:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572736 00000100:00100000:2.0:1789050070.730756:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572736 00000100:00100000:2.0:1789050070.730826:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 289 00000100:00100000:2.0:1789050070.730838:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691572736:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050070.730931:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2348:x1875954691572736:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 95us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050070.730957:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 289 00000100:00100000:3.0:1789050070.732109:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572992 00000100:00100000:3.0:1789050070.732134:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572992 00000100:00100000:3.0:1789050070.732252:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:3.0:1789050070.732263:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691572992:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050070.732327:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+7:2348:x1875954691572992:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 67us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050070.732335:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00080000:2.0:1789050070.733563:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050070.735254:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050070.735303:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573120 00000100:00100000:0.0:1789050070.735680:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573248 00000100:00100000:0.0:1789050070.735691:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573248 00000100:00100000:0.0:1789050070.735779:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691572864 00000100:00100000:0.0:1789050070.735783:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691572864 00000100:00100000:0.0:1789050070.735813:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 142 00000100:00100000:0.0:1789050070.735824:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691573248:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050070.735910:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:2348:x1875954691573248:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 87us (5339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050070.735917:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 142 00000100:00100000:0.0:1789050070.735949:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 143 00000100:00100000:0.0:1789050070.735956:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:2348:x1875954691572864:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050070.735960:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573120 00000100:00100000:0.0:1789050070.735990:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+19:2348:x1875954691572864:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 35us (5311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050070.735997:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:0.0:1789050070.735997:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 143 00000100:00100000:1.0:1789050070.736007:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691573120:12345-192.168.206.1@tcp:400:kworker.0 00000100:00080000:2.0:1789050070.736013:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050070.736020:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050070.736038:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2348:x1875954691573120:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050070.736045:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 86 00010000:00010000:0.0:1789050071.184363:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050072.203435:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050072.312125:0:12799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:21:11 (1789050071) 00000100:00100000:2.0:1789050072.715807:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704133632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050072.715869:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050072.715933:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133632 00000100:00100000:2.0:1789050072.715940:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133632 00000100:00100000:2.0:1789050072.716068:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789050072.716078:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704133632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050072.716182:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050072.716252:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704133632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050072.716259:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789050072.716280:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050072.716313:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950604c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704133632:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789050072.767869:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00080000:3.0:1789050072.767885:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789050072.768663:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789050072.768675:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789050073.230245:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050073.867430:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789050073.867439:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050073.867798:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789050073.867805:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789050074.258595:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050074.511733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050074.511848:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573376 00000100:00100000:3.0:1789050074.511857:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573376 00000100:00100000:3.0:1789050074.511928:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 238 00000100:00100000:3.0:1789050074.511950:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d9065b0-db35-40d7-baad-6d6fd77aa842+5:12290:x1875954691573376:12345-192.168.206.1@tcp:101:lsof.0 00010000:00010000:3.0:1789050074.511968:0:12561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050074.511987:0:12561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fb90 expref: -99 pid: 12561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512048:0:12561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512061:0:12561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512073:0:12561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050074.512106:0:12561:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050074.512110:0:12561:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050074.512147:0:12561:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512187:0:12561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06600/0x9df728c939b79a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb90 expref: 7 pid: 12561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512246:0:12561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb90 expref: 6 pid: 12561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050074.512255:0:12561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:3.0:1789050074.512258:0:12561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050074.512262:0:12561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07200, rc 0) 00000100:00100000:3.0:1789050074.512312:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:12290:x1875954691573376:12345-192.168.206.1@tcp:101:lsof.0 Request processed in 375us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.512319:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 238 00000100:00080000:2.0:1789050074.512967:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050074.763589:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704133888:0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.763651:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050074.763703:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704134400:0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.763728:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050074.763757:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050074.763763:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704134016:0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.763785:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050074.763859:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704134144:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.763889:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050074.763916:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789050074.763922:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704133760:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.763948:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050074.763968:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704134272:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.763986:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050074.764013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133888 00000100:00100000:0.0:1789050074.764020:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133888 00000100:00100000:0.0:1789050074.764054:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134016 00000100:00100000:0.0:1789050074.764057:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134016 00000100:00100000:0.0:1789050074.764079:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134272 00000100:00100000:0.0:1789050074.764082:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134272 00000100:00100000:0.0:1789050074.764113:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789050074.764122:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704133888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.764217:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704133888:12345-0@lo:400:kworker.0 Request processed in 74us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.764225:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789050074.764242:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789050074.764249:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704134016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.764277:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704134016:12345-0@lo:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.764282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789050074.764293:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789050074.764299:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704134272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.764336:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704134272:12345-0@lo:400:kworker.0 Request processed in 36us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050074.764342:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789050074.764378:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704134272:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.764407:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704134016:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.764417:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704133888:0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.764615:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134400 00000100:00100000:1.0:1789050074.764620:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134400 00000100:00100000:1.0:1789050074.764656:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134144 00000100:00100000:1.0:1789050074.764659:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134144 00000100:00100000:1.0:1789050074.764683:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789050074.764692:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704134400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.764729:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704134400:12345-0@lo:400:kworker.0 Request processed in 40us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.764735:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789050074.764747:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789050074.764754:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704134144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050074.764784:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704134144:12345-0@lo:400:kworker.0 Request processed in 31us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050074.764790:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789050074.764901:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704133760 00000100:00100000:3.0:1789050074.764906:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704133760 00000100:00100000:3.0:1789050074.764943:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789050074.764950:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704133760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050074.764984:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3284:x1875954704133760:12345-0@lo:400:kworker.0 Request processed in 36us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050074.764990:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1789050074.765287:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050074.765292:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050074.765295:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050074.765378:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704133760:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.765392:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704134144:0@lo:400:kworker.0 00000100:00100000:0.0:1789050074.765418:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704134400:0@lo:400:kworker.0 00010000:00010000:3.0:1789050075.275575:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050075.275591:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704134528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050075.275657:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050075.275881:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134528 00000100:00100000:2.0:1789050075.275909:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134528 00000100:00100000:2.0:1789050075.275959:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050075.275968:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704134528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050075.276000:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050075.276050:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704134528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.276057:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789050075.276239:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704134528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050075.857712:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050075.857762:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050075.857797:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050075.857825:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050075.857872:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050075.857947:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573504 00000100:00100000:3.0:1789050075.857961:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573504 00000100:00100000:3.0:1789050075.858022:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 291 00000100:00100000:3.0:1789050075.858035:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691573504:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050075.858141:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95072078b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2349:x1875954691573504:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 108us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050075.858170:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 291 00000100:00100000:2.0:1789050075.858472:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691574016 00000100:00100000:2.0:1789050075.858477:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691574016 00000100:00100000:2.0:1789050075.858522:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573632 00000100:00100000:2.0:1789050075.858525:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573632 00000100:00100000:2.0:1789050075.858557:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 147 00000100:00100000:2.0:1789050075.858565:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2349:x1875954691574016:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.858607:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2349:x1875954691574016:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 43us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.858614:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 147 00000100:00100000:2.0:1789050075.858628:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 148 00000100:00100000:2.0:1789050075.858635:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+18:2349:x1875954691573632:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050075.858666:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c118c85-b079-4c51-87ec-099389ee7be3+18:2349:x1875954691573632:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 30us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050075.858671:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 148 00000100:00080000:2.0:1789050075.858698:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050075.860690:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573760 00000100:00100000:3.0:1789050075.860692:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691573888 00000100:00100000:3.0:1789050075.860706:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573888 00000100:00100000:1.0:1789050075.860708:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691573760 00000100:00080000:2.0:1789050075.860882:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050075.860888:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050075.862316:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:3.0:1789050075.862337:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691573888:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050075.862563:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c118c85-b079-4c51-87ec-099389ee7be3+5:2349:x1875954691573888:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 235us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050075.862572:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:1.0:1789050075.864829:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:1.0:1789050075.864854:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2349:x1875954691573760:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050075.865149:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c118c85-b079-4c51-87ec-099389ee7be3+7:2349:x1875954691573760:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 307us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050075.865170:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:2.0:1789050076.166477:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050076.166575:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691574272 00000100:00100000:3.0:1789050076.166585:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691574272 00000100:00100000:3.0:1789050076.166639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:3.0:1789050076.166658:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+18:12292:x1875954691574272:12345-192.168.206.1@tcp:35:umount.0 00000100:00100000:3.0:1789050076.166975:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+19:12292:x1875954691574272:12345-192.168.206.1@tcp:35:umount.0 Request processed in 327us (506us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789050076.166983:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 66 00000100:00100000:2.0:1789050076.175125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050076.175242:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691574528 00000100:00100000:3.0:1789050076.175252:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691574528 00000100:00100000:3.0:1789050076.175306:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:3.0:1789050076.175315:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+19:12292:x1875954691574528:12345-192.168.206.1@tcp:35:umount.0 00000100:00100000:3.0:1789050076.175637:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:12292:x1875954691574528:12345-192.168.206.1@tcp:35:umount.0 Request processed in 321us (519us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1789050076.175645:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 67 00000100:00100000:0.0:1789050076.187517:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050076.187597:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691574784 00000100:00100000:3.0:1789050076.187607:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691574784 00000100:00100000:3.0:1789050076.187662:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:3.0:1789050076.187687:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950728da4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+20:12292:x1875954691574784:12345-192.168.206.1@tcp:35:umount.0 00000100:00100000:3.0:1789050076.187907:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950728da4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:12292:x1875954691574784:12345-192.168.206.1@tcp:35:umount.0 Request processed in 222us (407us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789050076.187916:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 68 00000100:00100000:2.0:1789050076.193529:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050076.193603:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575040 00000100:00100000:3.0:1789050076.193613:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575040 00000100:00100000:3.0:1789050076.193675:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:3.0:1789050076.193684:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+21:12292:x1875954691575040:12345-192.168.206.1@tcp:35:umount.0 00000100:00100000:3.0:1789050076.194009:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c118c85-b079-4c51-87ec-099389ee7be3+22:12292:x1875954691575040:12345-192.168.206.1@tcp:35:umount.0 Request processed in 325us (487us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1789050076.194018:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 69 00000100:00100000:0.0:1789050076.197064:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050076.197125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050076.197260:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575168 00000100:00100000:1.0:1789050076.197270:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575168 00000100:00100000:1.0:1789050076.197329:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575296 00000100:00100000:1.0:1789050076.197333:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575296 00000100:00100000:1.0:1789050076.197351:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:1.0:1789050076.197360:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950703e91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+14:2350:x1875954691575168:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050076.197374:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050076.197391:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f400/0x9df728c939b78a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f722 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050076.197410:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050076.197466:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950703e91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+13:2350:x1875954691575168:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050076.197473:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:1.0:1789050076.197523:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:1.0:1789050076.197530:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+12:2350:x1875954691575296:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050076.197538:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050076.197547:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05fc00/0x9df728c939b78a12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f6ea expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050076.197556:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050076.197574:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:2350:x1875954691575296:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 45us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050076.197580:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:0.0:1789050076.200483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050076.200565:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575424 00000100:00100000:1.0:1789050076.200585:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575424 00000100:00100000:1.0:1789050076.200641:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:1.0:1789050076.200651:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:2348:x1875954691575424:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050076.200663:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050076.200680:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05fa00/0x9df728c939b78cc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7ed expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050076.200696:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050076.200752:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691575424:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050076.200760:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050076.202893:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050076.202985:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575552 00000100:00100000:2.0:1789050076.202994:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575552 00000100:00100000:2.0:1789050076.203044:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 73 00000100:00100000:2.0:1789050076.203054:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+5:2346:x1875954691575552:12345-192.168.206.1@tcp:9:umount.0 00000020:00000080:2.0:1789050076.203089:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78d84 00000100:00080000:2.0:1789050076.203100:0:6670:0:(import.c:65:import_set_state_nolock()) ffff950704c52800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050076.203139:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789050076.203434:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c118c85-b079-4c51-87ec-099389ee7be3+2:2346:x1875954691575552:12345-192.168.206.1@tcp:9:umount.0 Request processed in 381us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050076.203443:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 73 00010000:00010000:0.0:1789050076.203624:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050076.210911:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050076.211239:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691575936 00000100:00100000:0.0:1789050076.211248:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691575936 00000100:00100000:0.0:1789050076.211296:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 74 00000100:00100000:0.0:1789050076.211305:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+7:2346:x1875954691575936:12345-192.168.206.1@tcp:9:umount.0 00000020:00000080:0.0:1789050076.211330:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78fe5 00000020:00010000:0.0:1789050076.211340:0:6672:0:(genops.c:1920:obd_stale_export_put()) Put export ffff950605aaf000: total 0 00000100:00080000:0.0:1789050076.211344:0:6672:0:(import.c:65:import_set_state_nolock()) ffff950605aac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789050076.211441:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789050076.211807:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2c118c85-b079-4c51-87ec-099389ee7be3+5:2346:x1875954691575936:12345-192.168.206.1@tcp:9:umount.0 Request processed in 496us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050076.211815:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 74 00000020:00010000:1.0:1789050076.212919:0:5805:0:(genops.c:1906:obd_stale_export_get()) Get export ffff950605aaf000: total 0 00010000:00010000:1.0:1789050076.213024:0:5805:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff950605aaf000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789050076.213141:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79388 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9c2 expref: 4 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050076.213296:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb3cb05/0x9df728c939b79a18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb89 expref: 3 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050076.213312:0:5805:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff950605aaf000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789050076.213325:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050076.213327:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050076.213329:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050076.223837:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050076.223955:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691576960 00000100:00100000:2.0:1789050076.223966:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691576960 00000100:00100000:2.0:1789050076.224029:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 239 00000100:00100000:2.0:1789050076.224039:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+22:2346:x1875954691576960:12345-192.168.206.1@tcp:39:umount.0 00000020:00000080:2.0:1789050076.224070:0:8158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78a20 00000020:00010000:2.0:1789050076.224097:0:8158:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9507033bc800: total 0 00000100:00080000:2.0:1789050076.224102:0:8158:0:(import.c:65:import_set_state_nolock()) ffff950702ca0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050076.224129:0:8158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967532 00000020:00010000:3.0:1789050076.224391:0:5804:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9507033bc800: total 0 00010000:00010000:3.0:1789050076.224432:0:5804:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff9507033bc800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789050076.224462:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050076.224466:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050076.224475:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f8e9 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224494:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507114dc400) 00010000:00010000:3.0:1789050076.224497:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050076.224510:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b78cea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7fb expref: 20 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224531:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050076.224545:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050076.224550:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b79373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9bb expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224564:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:3.0:1789050076.224567:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050076.224570:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b793dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9d7 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224583:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050076.224586:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789050076.224590:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79a03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb82 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224601:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050076.224603:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050076.224607:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331800/0x9df728c939b79269 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f975 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224617:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050076.224618:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050076.224622:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06400/0x9df728c939b799d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb74 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224632:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050076.224634:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789050076.224637:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51000/0x9df728c939b78d5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f817 expref: 14 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224665:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950732cb4e00) 00010000:00010000:3.0:1789050076.224668:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050076.224672:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b78d06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f802 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224699:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050076.224702:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050076.224705:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531a00/0x9df728c939b796d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fab0 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224716:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9507114dcf00) 00010000:00010000:3.0:1789050076.224718:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050076.224722:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530000/0x9df728c939b798f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb3c expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224736:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050076.224738:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789050076.224741:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b793f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9de expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224753:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff950714b52600) 00010000:00010000:3.0:1789050076.224755:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050076.224759:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331e00/0x9df728c939b79349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f9ad expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050076.224769:0:5804:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff9507033bc800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789050076.224782:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050076.224790:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050076.224791:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050076.225406:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2c118c85-b079-4c51-87ec-099389ee7be3+7:2346:x1875954691576960:12345-192.168.206.1@tcp:39:umount.0 Request processed in 1365us (1574us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1789050076.225415:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 239 00010000:00010000:0.0:1789050076.299477:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050077.323428:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050077.836316:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050077.836338:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704134656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050077.836406:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050077.836645:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134656 00000100:00100000:3.0:1789050077.836655:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134656 00000100:00100000:3.0:1789050077.836718:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789050077.836729:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704134656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050077.836763:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050077.836832:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073d0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704134656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050077.836840:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789050077.836866:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050077.836904:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704134656:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789050077.908463:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:3.0:1789050077.908472:0:6698:0:(genops.c:885:class_export_put()) final put ffff950605aaf000/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:1.0:1789050077.908587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950605aaf000/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-OST0000 00000020:00000080:1.0:1789050077.908636:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605aac000 for lustre-OST0000 00000001:00100000:1.0:1789050077.909648:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000001:00080000:1.0:1789050077.909660:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967533 is committed 00000020:00000080:1.0:1789050077.909691:0:5839:0:(genops.c:885:class_export_put()) final put ffff9507033bc800/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:3.0:1789050077.909749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9507033bc800/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-MDT0000 00000020:00000080:3.0:1789050077.909799:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950702ca0000 for lustre-MDT0000 00010000:00010000:3.0:1789050078.347548:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050078.498036:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050078.498088:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050078.500795:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577088 00000100:00100000:1.0:1789050078.500811:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577088 00000100:00100000:1.0:1789050078.500885:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577216 00000100:00100000:1.0:1789050078.500889:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577216 00000100:00100000:1.0:1789050078.500912:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:1.0:1789050078.501126:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+11:2348:x1875954691577088:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050078.501231:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050078.501248:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031000/0x9df728c939b78af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f737 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050078.501266:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050078.501482:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+10:2348:x1875954691577088:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 560us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050078.501501:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:1.0:1789050078.501522:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:1.0:1789050078.501532:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+9:2350:x1875954691577216:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050078.501541:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050078.501551:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05fe00/0x9df728c939b78af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f761 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050078.501560:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050078.501579:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:2350:x1875954691577216:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 50us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050078.501584:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:3.0:1789050078.506057:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050078.507073:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577472 00000100:00100000:0.0:1789050078.507084:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577472 00000100:00100000:0.0:1789050078.507976:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:0.0:1789050078.507989:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bb2e670-8cb0-4737-a96d-2c875877eef5+8:2348:x1875954691577472:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050078.508006:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050078.508025:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701489000/0x9df728c939b78cb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f7e6 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050078.508041:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050078.508421:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bb2e670-8cb0-4737-a96d-2c875877eef5+7:2348:x1875954691577472:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 434us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050078.508442:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:0.0:1789050078.516993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050078.517610:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577600 00000100:00100000:2.0:1789050078.517620:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577600 00000100:00100000:2.0:1789050078.517704:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 240 00000100:00100000:2.0:1789050078.517715:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+6:2346:x1875954691577600:12345-192.168.206.1@tcp:39:umount.0 00000020:00000080:2.0:1789050078.517759:0:5817:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78b07 00000020:00010000:2.0:1789050078.517767:0:5817:0:(genops.c:1920:obd_stale_export_put()) Put export ffff950605765800: total 0 00000100:00080000:2.0:1789050078.517771:0:5817:0:(import.c:65:import_set_state_nolock()) ffff950605760000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050078.517802:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967533 00000020:00010000:1.0:1789050078.518239:0:8444:0:(genops.c:1906:obd_stale_export_get()) Get export ffff950605765800: total 0 00010000:00010000:1.0:1789050078.518244:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050078.518285:0:8444:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff950605765800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789050078.518330:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950732cb4200) 00010000:00010000:1.0:1789050078.518334:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050078.518342:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b79a26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fb90 expref: 7 pid: 12561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050078.518367:0:8444:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff950605765800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789050078.518379:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050078.518381:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050078.518382:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050078.518751:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d9065b0-db35-40d7-baad-6d6fd77aa842+3:2346:x1875954691577600:12345-192.168.206.1@tcp:39:umount.0 Request processed in 1036us (1764us total) trans 4294967534 rc 0/0 00000100:00100000:2.0:1789050078.518759:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 240 00000100:00080000:3.0:1789050078.520548:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050078.542817:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050078.542976:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577856 00000100:00100000:1.0:1789050078.542985:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577856 00000100:00100000:1.0:1789050078.543037:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 292 00000100:00100000:1.0:1789050078.543048:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+7:2346:x1875954691577856:12345-192.168.206.1@tcp:251:umount.0 00000020:00000080:1.0:1789050078.543100:0:5812:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b789fd 00000020:00010000:1.0:1789050078.543108:0:5812:0:(genops.c:1920:obd_stale_export_put()) Put export ffff950706339000: total 0 00000100:00080000:1.0:1789050078.543112:0:5812:0:(import.c:65:import_set_state_nolock()) ffff95073d0e1800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789050078.543192:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bb2e670-8cb0-4737-a96d-2c875877eef5+3:2346:x1875954691577856:12345-192.168.206.1@tcp:251:umount.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050078.543228:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 292 00000020:00010000:0.0:1789050078.543576:0:5805:0:(genops.c:1906:obd_stale_export_get()) Get export ffff950706339000: total 0 00010000:00010000:0.0:1789050078.543618:0:5805:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff950706339000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789050078.543647:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f000/0x9df728c939b78a51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34f729 expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050078.543663:0:5805:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff950706339000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789050078.543673:0:5805:0:(genops.c:885:class_export_put()) final put ffff950706339000/4bb2e670-8cb0-4737-a96d-2c875877eef5 00010000:00010000:0.0:1789050078.543691:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050078.543693:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050078.543694:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789050078.544191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950706339000/4bb2e670-8cb0-4737-a96d-2c875877eef5 for MGS 00000020:00000080:1.0:1789050078.544270:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073d0e1800 for MGS 00010000:00010000:0.0:1789050079.373914:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789050079.427695:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:1.0:1789050079.427705:0:7634:0:(genops.c:885:class_export_put()) final put ffff950704c57800/2c118c85-b079-4c51-87ec-099389ee7be3 00000020:00000080:1.0:1789050079.427738:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950704c57800/2c118c85-b079-4c51-87ec-099389ee7be3 for lustre-OST0001 00000020:00000080:1.0:1789050079.427793:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950704c52800 for lustre-OST0001 00000100:00100000:1.0:1789050079.883538:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704135040:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.883599:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.883685:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789050079.883691:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704134912:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.883715:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.883732:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704135424:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.883753:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050079.883798:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135040 00000100:00100000:1.0:1789050079.883805:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135040 00000100:00100000:1.0:1789050079.883853:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134912 00000100:00100000:1.0:1789050079.883856:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134912 00000100:00100000:1.0:1789050079.883878:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789050079.883887:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704135040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.883947:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704135040:12345-0@lo:400:kworker.0 Request processed in 60us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.883953:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789050079.883970:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789050079.883976:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704134912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.884002:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704134912:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.884008:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789050079.884044:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135424 00000100:00100000:1.0:1789050079.884048:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135424 00000100:00100000:1.0:1789050079.884084:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050079.884090:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704135424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.884124:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704135424:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.884130:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789050079.884145:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050079.884156:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050079.884193:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704134912:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.884228:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704135424:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.884238:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704135040:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.884748:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704134784:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.884797:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.884837:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704135296:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.884859:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050079.884977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704134784 00000100:00100000:0.0:1789050079.884982:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704134784 00000100:00100000:0.0:1789050079.885016:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789050079.885035:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.885081:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704134784:12345-0@lo:400:kworker.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050079.885087:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789050079.885242:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050079.885253:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704135168:0@lo:400:kworker.0 00000100:00100000:3.0:1789050079.885289:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050079.885312:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704134784:0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.885421:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135168 00000100:00100000:0.0:1789050079.885426:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135168 00000100:00100000:0.0:1789050079.885466:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789050079.885472:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050079.885519:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704135168:12345-0@lo:400:kworker.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050079.885525:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789050079.886360:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050079.886395:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704135168:0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.886540:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135296 00000100:00100000:1.0:1789050079.886546:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135296 00000100:00100000:1.0:1789050079.886603:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789050079.886611:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704135296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050079.886681:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950607607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704135296:12345-0@lo:400:kworker.0 Request processed in 71us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050079.886688:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789050079.886762:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704135296:0@lo:400:kworker.0 00000100:00080000:3.0:1789050079.886978:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1789050080.363926:0:13000:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789050080.377409:0:13000:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789050080.377525:0:13000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.377540:0:13000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.377548:0:13000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.377555:0:13000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.377585:0:13000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789050080.377591:0:13000:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789050080.377611:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050080.377615:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789050080.377633:0:13000:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789050080.377653:0:13000:0:(import.c:65:import_set_state_nolock()) ffff950702da5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789050080.377685:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704135552:0@lo:39:umount.0 00000100:00100000:1.0:1789050080.377748:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789050080.378140:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050080.378148:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.378156:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789050080.378159:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.378167:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050080.378173:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050080.378178:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050080.378180:0:8444:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789050080.378183:0:8444:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789050080.378244:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.378251:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050080.378275:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050080.378282:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05f400/0x9df728c939b78a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a97 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050080.378336:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050080.378351:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704135680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.378492:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050080.378632:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135552 00000100:00100000:1.0:1789050080.378639:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135552 00000100:00100000:1.0:1789050080.378683:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789050080.378692:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875954704135552:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789050080.378717:0:5819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7880c 00000100:00080000:1.0:1789050080.378724:0:5819:0:(import.c:65:import_set_state_nolock()) ffff95073f3ba800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789050080.378799:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3281:x1875954704135552:12345-0@lo:39:umount.0 Request processed in 106us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050080.378806:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789050080.378816:0:5819:0:(genops.c:885:class_export_put()) final put ffff95073f3b8800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789050080.378865:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950702da5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789050080.378873:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704135552:0@lo:39:umount.0 00000100:00080000:1.0:1789050080.378896:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050080.378899:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789050080.378903:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789050080.379935:0:13000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.379948:0:13000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.379954:0:13000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.379973:0:13000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.379990:0:13000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050080.379996:0:13000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380002:0:13000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380008:0:13000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380014:0:13000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380020:0:13000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789050080.380026:0:13000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380031:0:13000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380037:0:13000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380043:0:13000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380126:0:13000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789050080.380131:0:13000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380137:0:13000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380143:0:13000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380149:0:13000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050080.380157:0:13000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789050080.380160:0:13000:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789050080.380181:0:13000:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789050080.380184:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789050080.380187:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050080.380192:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1789050080.380219:0:13000:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95070633e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050080.380226:0:13000:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95073d0e2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050080.380232:0:13000:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff950605765800 0d9065b0-db35-40d7-baad-6d6fd77aa842 192.168.206.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050080.380236:0:13000:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff95073d2299c0) has exports, disconnecting them 00000020:00080000:1.0:1789050080.380241:0:13000:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95070633e800), last request at 1789050079 00000020:00000080:1.0:1789050080.380246:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7897f 00000100:00080000:1.0:1789050080.380260:0:13000:0:(import.c:65:import_set_state_nolock()) ffff95070633b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789050080.380304:0:13000:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95070633e800): rc 0 00000020:00000080:1.0:1789050080.380312:0:13000:0:(genops.c:885:class_export_put()) final put ffff95070633e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789050080.380318:0:13000:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95073d0e2800), last request at 1789050079 00000020:00000080:1.0:1789050080.380321:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b788b4 00000100:00080000:1.0:1789050080.380327:0:13000:0:(import.c:65:import_set_state_nolock()) ffff95073d0e7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789050080.380334:0:13000:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95073d0e2800): rc 0 00000020:00000080:1.0:1789050080.380336:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d0e2800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789050080.380343:0:13000:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa435c3f4bae0 00000100:00080000:1.0:1789050080.380359:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789050080.380363:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789050080.380376:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789050080.380432:0:13000:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789050080.380614:0:13000:0:(import.c:65:import_set_state_nolock()) ffff95060469a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789050080.380632:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789050080.380634:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789050080.380645:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789050080.380720:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704135808:0@lo:9:umount.0 00000100:00100000:1.0:1789050080.380842:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050080.380905:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1875954704135936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050080.380917:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135808 00000100:00100000:1.0:1789050080.380926:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135808 00000100:00100000:1.0:1789050080.380969:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789050080.380981:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875954704135808:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789050080.381000:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78901 00000100:00080000:1.0:1789050080.381007:0:6670:0:(import.c:65:import_set_state_nolock()) ffff95060469c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789050080.381028:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789050080.381195:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704135680 00000100:00100000:0.0:1789050080.381212:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704135680 00000100:00100000:0.0:1789050080.381250:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050080.381258:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3282:x1875954704135680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.381268:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.381285:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f600/0x9df728c939b78a97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a90 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381300:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.381338:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3282:x1875954704135680:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.381345:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789050080.381364:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789050080.381369:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381375:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488e00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050080.381379:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381386:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050080.381392:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050080.381411:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050080.381414:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789050080.381416:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789050080.381436:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381441:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050080.381471:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381487:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701488e00/0x9df728c939b78a9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78aa5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381501:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050080.381505:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381510:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bd24c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050080.381513:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381519:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050080.381525:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050080.381530:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050080.381532:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789050080.381534:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789050080.381554:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381559:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050080.381565:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381571:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bd24c00/0x9df728c939b789b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b789be expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381582:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050080.381585:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381590:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050080.381593:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381598:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050080.381604:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050080.381608:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789050080.381610:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789050080.381611:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789050080.381619:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381624:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050080.381628:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381638:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b78cab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78cb2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381646:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050080.381649:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381654:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ea00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050080.381657:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381663:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050080.381669:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050080.381674:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050080.381676:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789050080.381677:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789050080.381701:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381708:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050080.381714:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381720:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05ea00/0x9df728c939b7876b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78772 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.381741:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050080.381743:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050080.381744:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789050080.381754:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073f3b8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789050080.381815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95070633e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789050080.381854:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d0e2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789050080.381875:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073f3ba800 for lustre-MDT0000 00000020:00000080:0.0:1789050080.381879:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95070633b000 for lustre-MDT0000 00000020:00000080:0.0:1789050080.381882:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073d0e7800 for lustre-MDT0000 00010000:00010000:0.0:1789050080.381892:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050080.381905:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.381936:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050080.381965:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050080.381970:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.381988:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050080.382014:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136064 00000100:00100000:0.0:1789050080.382019:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136064 00000100:00100000:0.0:1789050080.382039:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136448 00000100:00100000:0.0:1789050080.382041:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136448 00000100:00100000:0.0:1789050080.382067:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789050080.382075:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950703e92050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+19:3285:x1875954704136064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.382083:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.382092:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701488000/0x9df728c939b78aa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a9e expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.382101:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.382135:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950703e92050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+18:3285:x1875954704136064:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.382142:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789050080.382175:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789050080.382180:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3285:x1875954704136448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.382186:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.382193:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bd25000/0x9df728c939b78772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b7876b expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.382226:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.382245:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3285:x1875954704136448:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.382250:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789050080.382278:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382286:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382303:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704136192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382323:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050080.382341:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704135680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382350:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050080.382355:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704136320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382372:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050080.382392:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136192 00000100:00100000:0.0:1789050080.382396:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136192 00000100:00100000:0.0:1789050080.382412:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136320 00000100:00100000:0.0:1789050080.382415:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136320 00000100:00100000:0.0:1789050080.382427:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789050080.382439:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+17:3282:x1875954704136192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.382447:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.382455:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950700031c00/0x9df728c939b789be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b789b7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.382464:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.382502:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+16:3282:x1875954704136192:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.382507:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789050080.382520:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050080.382526:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+15:3282:x1875954704136320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050080.382533:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050080.382540:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51400/0x9df728c939b78cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78cab expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050080.382548:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050080.382568:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:3282:x1875954704136320:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050080.382573:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050080.382597:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704136320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050080.382605:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3282:1875954704136192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050080.384861:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3281:x1875954704135808:12345-0@lo:9:umount.0 Request processed in 3878us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050080.384874:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789050080.384908:0:13000:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789050080.384945:0:13000:0:(import.c:65:import_set_state_nolock()) ffff950605b8f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789050080.384980:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95073d2299c0) has no exports 00000100:00100000:2.0:1789050080.385495:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704136576:0@lo:9:umount.0 00000100:00100000:2.0:1789050080.385584:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050080.385676:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136576 00000100:00100000:1.0:1789050080.385686:0:8215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136576 00000100:00100000:1.0:1789050080.385726:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789050080.385735:0:8215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875954704136576:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789050080.385756:0:8215:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b789e8 00000100:00080000:1.0:1789050080.385765:0:8215:0:(import.c:65:import_set_state_nolock()) ffff950605761800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789050080.385802:0:8215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789050080.386189:0:8215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3281:x1875954704136576:12345-0@lo:9:umount.0 Request processed in 454us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050080.386216:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1789050080.386659:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050080.386663:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050080.386665:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050080.386761:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050080.387053:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950605b8f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050080.387156:0:3281:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050080.393986:0:3281:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050080.394007:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704136576:0@lo:9:umount.0 00000100:00080000:2.0:1789050080.394072:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95060469a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050080.394121:0:3281:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050080.394123:0:3281:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050080.394151:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704135808:0@lo:9:umount.0 00010000:00010000:0.0:1789050080.396358:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789050080.402563:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95073d2299c0) has no exports 00000020:00000080:0.0:1789050080.470056:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787c6 00000020:00000080:0.0:1789050080.470071:0:13000:0:(genops.c:885:class_export_put()) final put ffff950736cee000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789050080.470085:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789050080.470331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950736cee000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789050080.470352:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050080.470362:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789050080.470366:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff95073f3db380) has no exports 00000020:00000080:1.0:1789050080.473043:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787bf 00000020:00000080:1.0:1789050080.473057:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073f2da000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789050080.473143:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050080.473154:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789050080.473157:0:13000:0:(genops.c:885:class_export_put()) final put ffff95072f421000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789050080.473160:0:13000:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f421000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789050080.473165:0:13000:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789050080.473463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073f2da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789050081.420080:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050082.444794:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789050083.013774:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d9065b0-db35-40d7-baad-6d6fd77aa842 00000001:00080000:1.0:1789050083.013795:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967534 is committed 00000020:00000080:1.0:1789050083.013800:0:5839:0:(genops.c:885:class_export_put()) final put ffff950605765800/0d9065b0-db35-40d7-baad-6d6fd77aa842 00000020:00000080:1.0:1789050083.013827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950605765800/0d9065b0-db35-40d7-baad-6d6fd77aa842 for lustre-MDT0000 00000020:00000080:1.0:1789050083.013927:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605760000 for lustre-MDT0000 00000001:00100000:2.0:1789050083.017971:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789050083.017984:0:6698:0:(genops.c:885:class_export_put()) final put ffff95060469f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050083.018280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95060469f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789050083.018353:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95060469c000 for lustre-OST0000 00010000:00010000:0.0:1789050083.470845:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050084.491412:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789050084.568678:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050084.568692:0:7634:0:(genops.c:885:class_export_put()) final put ffff950605760800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050084.568729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950605760800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789050084.568790:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605761800 for lustre-OST0001 00000100:00100000:1.0:1789050085.003923:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704136832:0@lo:400:kworker.0 00000100:00100000:1.0:1789050085.004014:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050085.004110:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050085.004117:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704136960:0@lo:400:kworker.0 00000100:00100000:1.0:1789050085.004140:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050085.004183:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136832 00000100:00100000:1.0:1789050085.004193:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136832 00000100:00100000:1.0:1789050085.004253:0:12561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136960 00000100:00100000:1.0:1789050085.004257:0:12561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136960 00000100:00100000:1.0:1789050085.004276:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789050085.004284:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875954704136832:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789050085.004292:0:12561:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789050085.004334:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875954704136832:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789050085.004341:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789050085.004358:0:12561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789050085.004361:0:12561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875954704136960:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789050085.004365:0:12561:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789050085.004383:0:12561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875954704136960:12345-0@lo:400:kworker.0 Request processed in 20us (243us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789050085.004388:0:12561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1789050085.004422:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050085.004426:0:3282:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789050085.004430:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789050085.005864:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136704:0@lo:400:kworker.0 00000100:00100000:0.0:1789050085.005941:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050085.006075:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704136704 00000100:00100000:3.0:1789050085.006083:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704136704 00000100:00100000:3.0:1789050085.006446:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789050085.006473:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:3285:x1875954704136704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050085.006539:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c5df17a-77a5-4faa-ab5f-0191afbe3474+14:3285:x1875954704136704:12345-0@lo:400:kworker.0 Request processed in 69us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050085.006546:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789050085.006658:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3285:1875954704136704:0@lo:400:kworker.0 00000100:00080000:1.0:1789050085.021841:0:3282:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050085.021870:0:3282:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 155 00000100:00080000:1.0:1789050085.021885:0:3282:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950604db9800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050085.021923:0:3282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee6d80 x1875954704137088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050085.022036:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704137088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789050085.022110:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050085.022528:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137088 00000100:00100000:3.0:1789050085.022546:0:8158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137088 00000100:00100000:3.0:1789050085.022615:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789050085.022626:0:8158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3281:x1875954704137088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789050085.022649:0:8158:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789050085.023516:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704136960:0@lo:400:kworker.0 00000100:00080000:1.0:1789050085.023551:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789050085.023555:0:3282:0:(import.c:65:import_set_state_nolock()) ffff950604dbd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789050085.023559:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789050085.023564:0:3282:0:(import.c:65:import_set_state_nolock()) ffff950604dbd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789050085.023567:0:3282:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 136 00000100:00080000:1.0:1789050085.023576:0:3282:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff950604dbd000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050085.023605:0:3282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee7b80 x1875954704137216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050085.024365:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704137216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789050085.024417:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050085.024539:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137216 00000100:00100000:0.0:1789050085.024546:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137216 00000100:00100000:0.0:1789050085.024585:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789050085.024591:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704137216:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789050085.024606:0:5819:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789050085.024644:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704137216:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (226us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789050085.024650:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789050085.024715:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950604dbd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050085.024719:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789050085.024722:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704137216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789050085.025011:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704136832:0@lo:400:kworker.0 00000100:00100000:3.0:1789050085.049324:0:8158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3281:x1875954704137088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 26686us (27201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789050085.049342:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789050085.052924:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050085.052937:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789050085.052942:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704137088:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789050085.516690:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050086.539612:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789050086.539754:0:13000:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95073c6bae40 - data ffff95070efe3510/ffff950605755000 00000020:01000000:1.0:1789050086.539909:0:13000:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9507100054e0 - data ffff95070ec6e5e8/ffff95073f3b5c00 00000001:00000004:1.0:1789050086.553619:0:13000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967534 00000100:00080000:2.0:1789050086.639300:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789050086.639312:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789050086.639338:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050086.639341:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789050086.639715:0:7073:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789050086.639720:0:7073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789050086.639731:0:7073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789050086.641536:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789050086.641544:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789050086.641568:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050086.641571:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789050086.641830:0:7942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789050086.641836:0:7942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789050086.641850:0:7942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789050086.701741:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7878e 00000020:00000080:2.0:1789050086.701758:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d219000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789050086.702650:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787a3 00000020:00000080:2.0:1789050086.702657:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d230800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789050086.702664:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789050086.702676:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050086.702704:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789050086.702709:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff95073d22cd40) has no exports 00000004:01000000:2.0:1789050086.702883:0:13000:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789050086.702893:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b789e1 00000020:00000080:2.0:1789050086.702897:0:13000:0:(genops.c:885:class_export_put()) final put ffff9507033b8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789050086.702902:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789050086.702907:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050086.702914:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789050086.702916:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff950706404d40) has no exports 00000020:00000080:2.0:1789050086.702923:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b789da 00000020:00000080:2.0:1789050086.702926:0:13000:0:(genops.c:885:class_export_put()) final put ffff950605b8c000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789050086.703351:0:13000:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789050086.703356:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789050086.703361:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789050086.703368:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050086.703371:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789050086.703407:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050086.703415:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789050086.703422:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b788fa 00000020:00000080:2.0:1789050086.703427:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d0e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789050086.703431:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789050086.703435:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050086.703439:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789050086.703442:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff95070345b380) has no exports 00000020:00000080:2.0:1789050086.703456:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b788f3 00000020:00000080:2.0:1789050086.703460:0:13000:0:(genops.c:885:class_export_put()) final put ffff95060469f800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789050086.703806:0:13000:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789050086.703810:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789050086.703812:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789050086.703816:0:13000:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050086.703818:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789050086.703844:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050086.703859:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789050086.703894:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050086.703898:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789050086.703926:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787aa 00000020:00000080:2.0:1789050086.703932:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d234800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789050086.703936:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789050086.703939:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050086.703943:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789050086.703945:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff95073d22b380) has no exports 00000020:00000080:2.0:1789050086.703964:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050086.703967:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789050086.703970:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787b1 00000020:00000080:2.0:1789050086.703974:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d235000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789050086.703981:0:13000:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950707961800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789050086.703985:0:13000:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950707961800 3 00000020:01000004:2.0:1789050086.703989:0:13000:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950707961800 from lustre-MDT0000 00000020:00000080:2.0:1789050086.704011:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050086.704014:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789050086.704016:0:13000:0:(genops.c:885:class_export_put()) final put ffff95073d21e000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789050086.704019:0:13000:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d21e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789050086.704029:0:13000:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789050086.704102:0:13000:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789050086.704106:0:13000:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789050086.704109:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789050086.704112:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050086.704115:0:13000:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789050086.704123:0:13000:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff950709dda000 4c5df17a-77a5-4faa-ab5f-0191afbe3474 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050086.704128:0:13000:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff950702d98000) has exports, disconnecting them 00000020:00080000:2.0:1789050086.704132:0:13000:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff950709dda000), last request at 1789049882 00000020:00000080:2.0:1789050086.704150:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7874f 00000020:00010000:2.0:1789050086.704154:0:13000:0:(genops.c:1920:obd_stale_export_put()) Put export ffff950709dda000: total 8 00000100:00080000:2.0:1789050086.704158:0:13000:0:(import.c:65:import_set_state_nolock()) ffff950709ddd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789050086.704191:0:13000:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff950709dda000): rc 0 00000020:00080000:2.0:1789050086.704196:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff950702d98000) has no exports 00000020:00000080:1.0:1789050086.704485:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d219000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789050086.704502:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d230800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789050086.704507:0:8:0:(genops.c:885:class_export_put()) final put ffff95073d21e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050086.704509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d21e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789050086.704519:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050086.704664:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9507033b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789050086.704670:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950605b8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789050086.704675:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605b8f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789050086.704681:0:8:0:(genops.c:885:class_export_put()) final put ffff9507207f6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050086.704683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9507207f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789050086.704687:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050086.704716:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d0e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789050086.704721:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95060469f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789050086.704724:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95060469a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789050086.704728:0:8:0:(genops.c:885:class_export_put()) final put ffff950604dbf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050086.704730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950604dbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789050086.704733:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050086.704799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d234800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789050086.704804:0:8:0:(genops.c:885:class_export_put()) final put ffff95073d236000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789050086.704806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d236000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789050086.704809:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789050086.704977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d235000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1789050086.705056:0:8444:0:(genops.c:1906:obd_stale_export_get()) Get export ffff950709dda000: total 0 00010000:00010000:0.0:1789050086.705090:0:8444:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff950709dda000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789050086.705122:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ec00/0x9df728c939b78a89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a82 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705141:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51a00/0x9df728c939b78c96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78c8f expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705151:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b78a7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a74 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705174:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51800/0x9df728c939b78ca4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78c9d expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705189:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ea00/0x9df728c939b78867 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78860 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705227:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331a00/0x9df728c939b78ab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78aac expref: 4 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705238:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330200/0x9df728c939b78a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a58 expref: 3 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705248:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0e800/0x9df728c939b78a6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b78a66 expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050086.705258:0:8444:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff950709dda000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789050086.705273:0:8444:0:(genops.c:885:class_export_put()) final put ffff950709dda000/4c5df17a-77a5-4faa-ab5f-0191afbe3474 00010000:00010000:0.0:1789050086.705286:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050086.705288:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050086.705290:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050086.705343:0:5812:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff95070f05c400:5812] 2 exiting: rc = 0 00000100:00100000:0.0:1789050086.705469:0:5811:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff950707c39200:5811] 1 exiting: rc = 0 00000020:00000080:1.0:1789050086.705548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950709dda000/4c5df17a-77a5-4faa-ab5f-0191afbe3474 for MGS 00000020:00000080:1.0:1789050086.705585:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950709ddd800 for MGS 00000100:00100000:3.0:1789050086.705773:0:5810:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff950732c35800:5810] 0 exiting: rc = 1 00000100:00100000:2.0:1789050086.706185:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706318:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706329:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706338:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706345:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706353:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706363:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706370:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706377:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706384:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706391:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706398:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706405:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706412:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706423:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706429:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706436:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706453:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706460:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706467:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706473:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706480:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706487:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706493:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706499:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706505:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706511:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706517:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706524:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706530:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706536:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706543:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706548:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706569:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706576:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706583:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706589:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706595:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706601:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706607:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706614:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706621:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706627:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706634:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706641:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706647:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706654:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706660:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706666:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706672:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706678:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706684:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706689:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706696:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706704:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706710:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706716:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706721:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706729:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706735:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706741:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706747:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706753:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.706759:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789050086.707438:0:13000:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789050086.707453:0:13000:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789050086.711237:0:13000:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95073c6bade0 - data ffff95070efe31b0/ffff950605754400 00000020:01000000:1.0:1789050086.711370:0:13000:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff950704f41900 - data ffff95070ec0fa20/ffff9507207d2000 00000020:00000080:1.0:1789050086.711943:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78733 00000020:00000080:1.0:1789050086.711954:0:13000:0:(genops.c:885:class_export_put()) final put ffff950708653800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789050086.711972:0:13000:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950707961800 from MGS, refs=2 00000020:01000004:1.0:1789050086.711976:0:13000:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950707961800 2 00000020:01000004:1.0:1789050086.711980:0:13000:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950707961800 from MGS 00000020:00000080:1.0:1789050086.712040:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050086.712050:0:13000:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789050086.712053:0:13000:0:(genops.c:885:class_export_put()) final put ffff950708655000/MGS 00000020:00000080:1.0:1789050086.712056:0:13000:0:(genops.c:844:class_export_destroy()) destroying export ffff950708655000/MGS for MGS 00000020:01000000:1.0:1789050086.712065:0:13000:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789050086.712137:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789050086.712141:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050086.712147:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789050086.712155:0:13000:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff950702da5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050086.712161:0:13000:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff950706400000) has exports, disconnecting them 00000020:00080000:1.0:1789050086.712166:0:13000:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff950702da5800), last request at 1789049884 00000020:00000080:1.0:1789050086.712172:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b787fe 00000020:00080000:1.0:1789050086.712180:0:13000:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff950702da5800): rc 0 00000020:00000080:1.0:1789050086.712185:0:13000:0:(genops.c:885:class_export_put()) final put ffff950702da5800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789050086.712798:0:13000:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789050086.712805:0:13000:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050086.712810:0:13000:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789050086.712818:0:13000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050086.712969:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050086.712975:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789050086.712981:0:13000:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950707961800 1 00000020:00000080:1.0:1789050086.712987:0:13000:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78725 00000020:00000080:1.0:1789050086.712993:0:13000:0:(genops.c:885:class_export_put()) final put ffff950708652800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789050086.712998:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789050086.713003:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050086.713005:0:13000:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789050086.713009:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9507064019c0) has no exports 00000020:00000080:0.0:1789050086.713242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950708653800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050086.713254:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950702da5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789050086.713260:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950702da5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789050086.713267:0:36:0:(genops.c:885:class_export_put()) final put ffff950720631800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789050086.713269:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950720631800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789050086.713273:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789050086.713351:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950708652800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050086.732561:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050086.732581:0:13000:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789050086.732588:0:13000:0:(genops.c:885:class_export_put()) final put ffff950707963800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789050086.732594:0:13000:0:(genops.c:844:class_export_destroy()) destroying export ffff950707963800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789050086.732607:0:13000:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789050086.732783:0:13000:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff950707960800 00000020:01000000:0.0:1789050086.732982:0:13000:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789050086.732987:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050086.732993:0:13000:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789050086.732998:0:13000:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff950702d9cd40) has no exports 00000100:00100000:0.0:1789050086.735504:0:5818:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff95072083c800:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1789050086.735639:0:5819:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff95072083c000:5819] 2 exiting: rc = 0 00000100:00100000:2.0:1789050086.736262:0:12561:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff95070a9cec00:12561] 4 exiting: rc = 0 00000100:00100000:2.0:1789050086.736354:0:5817:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff95070338b600:5817] 0 exiting: rc = 1 00000100:00100000:3.0:1789050086.736551:0:8158:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff95072060bc00:8158] 3 exiting: rc = 0 00000100:00100000:0.0:1789050086.736984:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.736992:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.736998:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737005:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737011:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737028:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737034:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737039:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737046:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737051:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737062:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737095:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737100:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737106:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737111:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737117:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737123:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737129:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737135:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737255:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737272:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737277:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737283:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737289:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737294:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737300:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737305:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737310:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737315:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737320:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737325:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737330:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737336:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737342:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737348:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737355:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737362:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737368:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737374:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737379:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737385:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737391:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737397:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737402:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737407:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737413:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737419:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737425:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737431:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737438:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737453:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737468:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737476:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737483:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737488:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737502:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737507:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737513:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737518:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737525:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737531:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737538:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737544:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.737550:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.745812:0:5820:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95072083da00:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1789050086.745941:0:5821:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff950703f69400:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1789050086.746384:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746396:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746403:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746409:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746421:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746429:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746439:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746455:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746470:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746475:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746482:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746489:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746495:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746501:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746507:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746513:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746519:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746525:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746531:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746537:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746543:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746548:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746554:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746560:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746566:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746572:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746594:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746600:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746606:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746612:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746618:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746623:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746628:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746634:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746639:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746645:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746652:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746658:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746663:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746669:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746674:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746680:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746686:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746691:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746697:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746702:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746707:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746712:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746717:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746723:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746734:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746739:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746745:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746750:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746756:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746762:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746768:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746774:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746841:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746849:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.746988:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.747002:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.747008:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.747014:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.751953:0:5822:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff950703f68a00:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1789050086.752081:0:5823:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff95070338ba00:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1789050086.753337:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753348:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753355:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753362:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753369:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753376:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753382:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753389:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753396:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753463:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753470:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753476:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753498:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753511:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753522:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753528:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753534:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753541:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753547:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753554:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753561:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753572:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753579:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753586:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753606:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753618:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753625:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753632:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753638:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.753644:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754101:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754127:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754136:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754143:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754161:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754168:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.754194:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755537:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755549:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755557:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755564:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755571:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755577:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755583:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755589:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755594:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755600:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755607:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755640:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755647:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755654:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755661:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755667:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755673:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755680:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755687:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755693:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755700:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755706:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755713:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755735:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755743:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755748:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.755755:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.782492:0:5824:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff950702991a00:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1789050086.782616:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95070338b000:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1789050086.782740:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782749:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782756:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782761:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782768:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782774:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782780:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782785:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782790:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782795:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782801:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782807:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782812:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782817:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782823:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782829:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782835:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782841:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782847:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782852:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782858:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782864:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782870:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782876:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782881:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782888:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782894:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782900:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782906:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782911:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782917:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782922:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782928:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782944:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782950:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782956:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782962:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782968:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782974:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782981:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782987:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782993:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.782999:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783005:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783011:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783081:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783090:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783095:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783101:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783106:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783111:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783117:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783122:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783128:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783133:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783138:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783144:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783149:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783154:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783159:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783164:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783169:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783174:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.783180:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.783849:0:5827:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95070352c800:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1789050086.783940:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff950728c92e00:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1789050086.784031:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784038:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784044:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784049:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784068:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784074:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784079:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784084:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784090:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784095:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784101:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784106:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784111:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784116:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784122:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784127:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784132:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784138:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784143:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784149:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784154:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784160:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784164:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784169:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784174:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784179:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784185:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784190:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784195:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784225:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784231:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784236:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784241:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784245:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784250:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784254:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784259:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784264:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784274:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784462:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784468:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784473:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784479:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784485:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784491:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784497:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784503:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784508:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784514:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784519:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784524:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784530:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784535:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784540:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784546:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784552:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784557:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784562:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784568:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784574:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784580:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784585:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784590:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784597:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.784976:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff95070352cc00:5829] 1 exiting: rc = 0 00000100:00100000:0.0:1789050086.785487:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff950728c92a00:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1789050086.785581:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785587:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785593:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785598:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785603:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785609:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785614:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785620:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785625:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785643:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785649:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785654:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785660:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785666:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785672:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785677:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785682:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785688:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785694:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785700:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785707:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785712:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785718:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785724:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785730:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785736:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785742:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785932:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785938:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785944:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785950:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785955:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785960:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785966:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785972:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785977:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785982:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785988:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785994:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.785999:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786004:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786009:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786015:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786084:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786098:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786103:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786109:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786115:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786120:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786126:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786132:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786137:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786143:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786149:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786154:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786159:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786165:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786170:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786176:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786181:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786187:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786192:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786302:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.786311:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050086.787440:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff95072f411000:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1789050086.787986:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff95072f410600:5831] 1 exiting: rc = 0 00000100:00100000:2.0:1789050086.788536:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff95072f411c00:5832] 2 exiting: rc = 0 00000100:00100000:2.0:1789050086.788612:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788620:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788625:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788631:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788638:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788644:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788650:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788656:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788662:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788669:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788675:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788681:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788687:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788714:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788721:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788744:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788752:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788758:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788765:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788772:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788780:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788787:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788793:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788799:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788805:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788812:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788819:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788825:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788832:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788839:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788845:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788852:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788858:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788865:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788871:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788878:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788886:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788892:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788898:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788919:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788926:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788933:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788939:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788945:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788951:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788957:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788963:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788971:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788986:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.788994:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789004:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789011:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789094:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789105:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789112:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789118:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789125:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789132:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789139:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789146:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789153:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789159:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789166:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050086.789187:0:13000:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789050086.795471:0:13000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050086.795490:0:13000:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789050086.795497:0:13000:0:(genops.c:885:class_export_put()) final put ffff950720633000/MDS_uuid 00000020:00000080:0.0:1789050086.795504:0:13000:0:(genops.c:844:class_export_destroy()) destroying export ffff950720633000/MDS_uuid for MDS 00000020:01000000:0.0:1789050086.795512:0:13000:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789050086.795671:0:13000:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789050087.571154:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050088.587879:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050089.611891:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789050089.826572:0:13154:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789050089.841831:0:13154:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789050089.841894:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.841913:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.841921:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.841929:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.842016:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789050089.842024:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789050089.842050:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789050089.842055:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789050089.842062:0:13154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789050089.842070:0:13154:0:(import.c:65:import_set_state_nolock()) ffff950604dbd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789050089.842076:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789050089.842078:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789050089.842081:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789050089.843759:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.843782:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.843790:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.843797:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.843877:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050089.843886:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.843894:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050089.843899:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.843909:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050089.843917:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050089.843923:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050089.843926:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789050089.843930:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789050089.843974:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844016:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050089.844064:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844072:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0f200/0x9df728c939b78a74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a7b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844089:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050089.844093:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844099:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050089.844102:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844109:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050089.844115:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050089.844120:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050089.844122:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789050089.844135:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844141:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050089.844147:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050089.844166:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050089.844168:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050089.844170:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050089.844311:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704137344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050089.844399:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050089.844483:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050089.844490:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704137472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050089.844516:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050089.844553:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137344 00000100:00100000:1.0:1789050089.844562:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137344 00000100:00100000:1.0:1789050089.844601:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137472 00000100:00100000:1.0:1789050089.844605:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137472 00000100:00100000:1.0:1789050089.844620:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050089.844629:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3284:x1875954704137344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789050089.844636:0:5803:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050089 with bad export cookie 11382611427924084559 00010000:00010000:2.0:1789050089.847691:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789050089.847712:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703330000/0x9df728c939b78a82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78a89 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.847741:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.847772:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.847780:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.847788:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050089.847815:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050089.847820:0:13154:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789050089.847825:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789050089.847859:0:13154:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789050089.847864:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789050089.847872:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050089.847879:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789050089.847884:0:13154:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff95073f3dcd40) has no exports 00000020:00080000:2.0:1789050089.847917:0:13154:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff95073f3dcd40) has no exports 00010000:00010000:3.0:1789050089.848090:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050089.848099:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.848107:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789050089.848111:0:8444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.848121:0:8444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050089.848137:0:8444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050089.848143:0:8444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789050089.848145:0:8444:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789050089.848147:0:8444:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789050089.848192:0:8444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.848238:0:8444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050089.848268:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.848275:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05e000/0x9df728c939b78c9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b78ca4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050089.848287:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050089.848289:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050089.848291:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050089.848299:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050089.848319:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704137600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050089.848395:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050089.848470:0:5801:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789050089.848480:0:5801:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789050089.850130:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050089.850284:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137600 00000100:00100000:3.0:1789050089.850298:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137600 00000020:01000000:2.0:1789050089.853795:0:13154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9507035b2de0 - data ffff950731be8e58/ffff950604cc0c00 00000020:01000000:2.0:1789050089.853993:0:13154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95073790eb40 - data ffff950731be9510/ffff950604d3b000 00000100:00100000:0.0:1789050089.854251:0:13155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789050089.854264:0:13155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3284:x1875954704137472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789050089.854274:0:13155:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050089 with bad export cookie 11382611427924084559 00000100:00100000:0.0:1789050089.854384:0:13155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3284:x1875954704137472:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (9865us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789050089.854391:0:13155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789050089.854414:0:13155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789050089.854418:0:13155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875954704137600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789050089.854423:0:13155:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050089 with bad export cookie 11382611427924084559 00000100:00100000:0.0:1789050089.854468:0:13155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875954704137600:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (6073us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789050089.854474:0:13155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789050089.854606:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789050089.854613:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9507207f4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789050089.854617:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789050089.857606:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789050089.858243:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3284:x1875954704137344:12345-0@lo:103:ldlm_bl.0 Request processed in 13607us (13839us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789050089.858259:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789050089.859880:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789050089.859887:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789050089.859897:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c574380 x1875954704137344/t0(0) o103->MGC192.168.206.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050105 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050089.859914:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c577100 x1875954704137472/t0(0) o103->MGC192.168.206.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050105 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050089.859924:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c21b480 x1875954704137600/t0(0) o103->MGC192.168.206.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050105 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789050089.859934:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789050089.859938:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789050089.859939:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789050089.860769:0:3284:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9507207f4800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789050089.861104:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704137344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050089.861137:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3284:1875954704137472:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789050089.861357:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9507207f4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050089.861364:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.101@tcp: connect to NID 0@lo last attempt 118 00000100:00080000:3.0:1789050089.861379:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.101@tcp: import ffff9507207f4800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050089.861415:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c218000 x1875954704137728/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050089.861483:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3281:1875954704137728:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1789050089.861537:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875954704137728 offset 0 length 520: 4 00000100:00100000:3.0:1789050089.861606:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3283:1875954704137600:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1789050089.876341:0:13154:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789050089.904917:0:13154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78883 00000020:00000080:3.0:1789050089.904930:0:13154:0:(genops.c:885:class_export_put()) final put ffff95060469d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789050089.904954:0:13154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95071009a800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789050089.904958:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95071009a800 2 00000020:01000004:3.0:1789050089.904962:0:13154:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95071009a800 from lustre-OST0000 00000020:00000080:3.0:1789050089.904989:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050089.905001:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789050089.905004:0:13154:0:(genops.c:885:class_export_put()) final put ffff950604699000/lustre-OST0000_UUID 00000020:00000080:3.0:1789050089.905007:0:13154:0:(genops.c:844:class_export_destroy()) destroying export ffff950604699000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789050089.905026:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789050089.905078:0:13154:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789050089.905096:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789050089.905100:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050089.905106:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789050089.905114:0:13154:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95073d0e3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789050089.905121:0:13154:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff95073f3d99c0) has exports, disconnecting them 00000020:00080000:3.0:1789050089.905127:0:13154:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95073d0e3000), last request at 1789049900 00000020:00000080:3.0:1789050089.905131:0:13154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b788ad 00000020:00080000:3.0:1789050089.905142:0:13154:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95073d0e3000): rc 0 00000020:00000080:3.0:1789050089.905148:0:13154:0:(genops.c:885:class_export_put()) final put ffff95073d0e3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789050089.906007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95060469d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789050089.906032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d0e3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789050089.907507:0:13154:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789050089.907517:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050089.907522:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789050089.907533:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789050089.907759:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050089.907770:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789050089.907780:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95071009a800 1 00000020:00000080:2.0:1789050089.907788:0:13154:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7883d 00000020:00000080:2.0:1789050089.907797:0:13154:0:(genops.c:885:class_export_put()) final put ffff950724fab800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789050089.907816:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789050089.907822:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050089.907827:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789050089.907832:0:13154:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff95073f3d8000) has no exports 00000020:00000080:1.0:1789050089.907914:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950604dbd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789050089.907923:0:8:0:(genops.c:885:class_export_put()) final put ffff950604dbf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789050089.907926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950604dbf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789050089.907934:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789050089.908019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950724fab800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789050089.931892:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050089.931911:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789050089.931933:0:13154:0:(genops.c:885:class_export_put()) final put ffff95071009d800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789050089.931939:0:13154:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789050089.931948:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789050089.932130:0:13154:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95071009a000 00000020:02000400:1.0:1789050089.932183:0:13154:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789050090.123571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4c5df17a-77a5-4faa-ab5f-0191afbe3474->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789050090.123586:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4c5df17a-77a5-4faa-ab5f-0191afbe3474->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050090.123589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789050090.123593:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789050090.123598:0:36:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050090.123608:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 321 00000100:00080000:3.0:1789050090.123616:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789050090.123632:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950604db9800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050090.123688:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c21b480 x1875954704137856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050090.123825:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704137856:0@lo:38:kworker.0 00000400:00000100:0.0:1789050090.123888:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875954704137856 offset 0 length 520: 4 00010000:00010000:0.0:1789050090.636034:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050091.661973:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050092.684159:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789050092.937019:0:13305:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789050092.950645:0:13305:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789050092.950748:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.950767:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.950776:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.950784:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.950823:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789050092.950831:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789050092.950859:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050092.950873:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c21b480 x1875954704137856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050105 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050092.950894:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789050092.950901:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789050092.950909:0:13305:0:(import.c:65:import_set_state_nolock()) ffff950604db9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789050092.950915:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789050092.950919:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c21b480 x1875954704137856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050105 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050092.950944:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789050092.950948:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1789050092.951026:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050092.951035:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.951044:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0e400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050092.951048:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.951058:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050092.951066:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050092.951073:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050092.951076:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789050092.951079:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789050092.951095:0:5805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9507207f4800 00010000:00010000:2.0:1789050092.951099:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.951106:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b78a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78a5f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.951120:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050092.951122:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050092.951124:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050092.951384:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704137856:0@lo:38:kworker.0 00010000:00010000:1.0:1789050092.952393:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952419:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952427:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952434:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952460:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050092.952469:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952476:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952482:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952489:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050092.952504:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789050092.952509:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789050092.952546:0:13305:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789050092.952552:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789050092.952557:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050092.952564:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789050092.952569:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff95073d228000) has no exports 00000020:00080000:1.0:1789050092.952599:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff95073d228000) has no exports 00010000:00010000:2.0:1789050092.954377:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050092.954395:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954418:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ee00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050092.954424:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954436:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050092.954448:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050092.954454:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050092.954456:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789050092.954460:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789050092.954482:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9507207f4800 00010000:00010000:2.0:1789050092.954486:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954493:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95070f05ee00/0x9df728c939b78a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78a6d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954512:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050092.954516:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954522:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050092.954544:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954552:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050092.954557:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050092.954562:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789050092.954565:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789050092.954567:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789050092.954574:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9507207f4800 00010000:00010000:2.0:1789050092.954577:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954583:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701489200/0x9df728c939b78c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78c96 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050092.954600:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050092.954601:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050092.954604:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050092.954716:0:8444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789050092.955142:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9507035b24e0 - data ffff95070eff7a20/ffff950604e1a800 00000020:01000000:1.0:1789050092.955623:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95073d1e9600 - data ffff950731b55948/ffff950605f0bc00 00100000:10000000:1.0:1789050092.979314:0:13305:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789050093.016934:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7894e 00000020:00000080:3.0:1789050093.016949:0:13305:0:(genops.c:885:class_export_put()) final put ffff950605767000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789050093.016978:0:13305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95073d0e4000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789050093.016982:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95073d0e4000 2 00000020:01000004:3.0:1789050093.016985:0:13305:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95073d0e4000 from lustre-OST0001 00000020:00000080:3.0:1789050093.017022:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050093.017045:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789050093.017049:0:13305:0:(genops.c:885:class_export_put()) final put ffff950605766000/lustre-OST0001_UUID 00000020:00000080:3.0:1789050093.017052:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff950605766000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789050093.017061:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1789050093.017233:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950605767000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1789050093.018013:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4c5df17a-77a5-4faa-ab5f-0191afbe3474->MGS 00010000:00010000:3.0:1789050093.018038:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050093.018053:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050093.018061:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789050093.018064:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789050093.018068:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789050093.018085:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9507207f4800 00010000:00010000:3.0:1789050093.018089:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b78860 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78867 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050093.018110:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050093.018118:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050093.018124:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789050093.018126:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789050093.018129:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789050093.022439:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9507207f4800 00010000:00010000:3.0:1789050093.022454:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950701488400/0x9df728c939b78aac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b78ab3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789050093.022541:0:13305:0:(import.c:65:import_set_state_nolock()) ffff9507207f4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789050093.022569:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789050093.022572:0:13305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789050093.022574:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789050093.022581:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789050093.022595:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c218000 x1875954704137728/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789050099 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789050093.022625:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789050093.022629:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1789050093.022683:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4c5df17a-77a5-4faa-ab5f-0191afbe3474:3281:1875954704137728:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:3.0:1789050093.022721:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789050093.022731:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78741 00000020:00000080:3.0:1789050093.022740:0:13305:0:(genops.c:885:class_export_put()) final put ffff950720633800/4c5df17a-77a5-4faa-ab5f-0191afbe3474 00000020:01000000:3.0:1789050093.022763:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.101@tcp (flags='') 00000020:00000080:3.0:1789050093.022772:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050093.022780:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950720633800/4c5df17a-77a5-4faa-ab5f-0191afbe3474 for MGC192.168.206.101@tcp 00000020:00000080:3.0:1789050093.022781:0:13305:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789050093.022785:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff950706403380) has no exports 10000000:01000000:2.0:1789050093.023673:0:5815:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789050093.024101:0:13305:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.206.101@tcp: client import never connected 00000100:00080000:3.0:1789050093.024106:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789050093.024110:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789050093.024113:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789050093.024116:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789050093.024191:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050093.024223:0:13305:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.101@tcp (uuid 4c5df17a-77a5-4faa-ab5f-0191afbe3474) 00000020:01000000:3.0:1789050093.024235:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789050093.024238:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9507207f4800 for MGC192.168.206.101@tcp 00000020:00000080:3.0:1789050093.024241:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050093.024246:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1789050093.024247:0:8:0:(genops.c:885:class_export_put()) final put ffff9507207f4000/4c5df17a-77a5-4faa-ab5f-0191afbe3474 00000020:00000080:1.0:1789050093.024251:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9507207f4000/4c5df17a-77a5-4faa-ab5f-0191afbe3474 for MGC192.168.206.101@tcp 00000020:00080000:3.0:1789050093.024253:0:13305:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95070633d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:01000000:1.0:1789050093.024257:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.101@tcp (4c5df17a-77a5-4faa-ab5f-0191afbe3474) 00000020:00080000:3.0:1789050093.024259:0:13305:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff950703458000) has exports, disconnecting them 00000020:00080000:3.0:1789050093.024263:0:13305:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95070633d800), last request at 1789049919 00000020:00000080:3.0:1789050093.024268:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b78978 00000020:00080000:3.0:1789050093.024280:0:13305:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95070633d800): rc 0 00000020:00000080:3.0:1789050093.024285:0:13305:0:(genops.c:885:class_export_put()) final put ffff95070633d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789050093.024735:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95070633d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789050093.047318:0:13305:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789050093.047330:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050093.047335:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789050093.047373:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050093.047538:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950604db9800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789050093.048724:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789050093.054762:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789050093.060941:0:8444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789050093.061250:0:5800:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95072c94ae00:5800] 1 exiting: rc = 0 00000100:00100000:0.0:1789050093.061376:0:5799:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff950706538600:5799] 0 exiting: rc = 1 00000100:00100000:0.0:1789050093.071692:0:6686:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff95073f381a00:6686] 2 exiting: rc = 0 00000100:00100000:1.0:1789050093.071905:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.072252:0:5803:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff950706539400:5803] 2 exiting: rc = 0 00000100:00100000:0.0:1789050093.072483:0:5801:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff950706538400:5801] 0 exiting: rc = 1 00000100:00100000:0.0:1789050093.072550:0:13155:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff950604d45000:13155] 3 exiting: rc = 0 00000100:00100000:0.0:1789050093.073342:0:5802:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95072c94b200:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1789050093.073842:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073852:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073863:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073871:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073878:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073885:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073892:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073899:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073906:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073929:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073935:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073942:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073948:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073955:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073963:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073974:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073981:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073988:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073994:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.073999:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074005:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074010:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074016:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074021:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074027:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074033:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074039:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074045:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074052:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074059:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074065:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074071:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074078:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074084:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074090:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074095:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074101:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074106:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074114:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074119:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074125:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074132:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074138:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074144:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074158:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074164:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074169:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074175:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074181:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074187:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074194:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074315:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074322:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074328:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074334:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074339:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074345:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074351:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074355:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074440:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074448:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074453:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074459:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.074465:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789050093.076098:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050093.076112:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789050093.076119:0:13305:0:(genops.c:885:class_export_put()) final put ffff9507033bf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789050093.076124:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff9507033bf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789050093.076131:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789050093.076191:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95073d0e4000 1 00000020:00000080:1.0:1789050093.076227:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b7891d 00000020:00000080:1.0:1789050093.076236:0:13305:0:(genops.c:885:class_export_put()) final put ffff950704f52000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789050093.076254:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789050093.076260:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050093.076265:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789050093.076270:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff950702d9b380) has no exports 00000020:00000080:0.0:1789050093.080611:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950704f52000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789050093.106027:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050093.106049:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789050093.106056:0:13305:0:(genops.c:885:class_export_put()) final put ffff95073d0e7000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789050093.106062:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d0e7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789050093.106070:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789050093.106374:0:13305:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95073d0e2000 00000020:01000000:0.0:1789050093.106425:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789050093.106431:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050093.106437:0:13305:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789050093.106442:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff950702d999c0) has no exports 00000020:00000080:0.0:1789050093.106477:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050093.106484:0:13305:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789050093.106488:0:13305:0:(genops.c:885:class_export_put()) final put ffff950724fac000/OSS_uuid 00000020:00000080:0.0:1789050093.106490:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff950724fac000/OSS_uuid for OSS 00000020:01000000:0.0:1789050093.106494:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789050093.106578:0:6672:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff950702cac800:6672] 2 exiting: rc = 0 00000100:00080000:1.0:1789050093.107018:0:5813:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789050093.107121:0:6670:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff95073c766a00:6670] 0 exiting: rc = 1 00000100:00100000:1.0:1789050093.107191:0:8215:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff95073cfea400:8215] 3 exiting: rc = 0 00000100:00100000:1.0:1789050093.108310:0:6671:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff95073f400000:6671] 1 exiting: rc = 0 00000100:00100000:0.0:1789050093.108601:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108629:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108638:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108645:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108651:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108657:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108662:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108667:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108686:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108691:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108696:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108702:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108708:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108713:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108719:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108724:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108729:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108735:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108741:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108746:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108751:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108756:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108761:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108766:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108771:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108777:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108782:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108788:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108793:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108799:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108804:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108810:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108815:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108821:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108826:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108832:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108838:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108843:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108848:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108853:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108859:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108866:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108871:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108885:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108890:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108896:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108902:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108907:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108912:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108917:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108923:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108928:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108935:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108940:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108946:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108951:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108957:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108962:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108968:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108973:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108979:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108985:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108991:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.108997:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050093.116080:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9507033ee200:6673] 0 exiting: rc = 1 00000100:00100000:3.0:1789050093.118012:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95073cdffa00:6675] 1 exiting: rc = 0 00000100:00100000:0.0:1789050093.119308:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119318:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119324:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119330:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119336:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119341:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119347:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119353:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119358:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119364:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119370:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119375:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119380:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119387:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119420:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119427:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119433:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119440:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119446:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119452:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119459:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119465:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119470:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119476:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119482:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119488:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119493:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119499:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119504:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119510:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119515:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119521:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119527:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119532:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119538:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119544:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119549:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119555:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119560:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119564:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119570:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119576:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119582:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119588:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119594:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119611:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119618:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119624:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119629:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119643:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119649:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119655:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119660:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119668:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119674:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119681:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119687:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119692:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119698:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119704:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119709:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119715:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119720:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.119726:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.121319:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff950710091c00:6677] 1 exiting: rc = 0 00000100:00100000:0.0:1789050093.121576:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff950710091a00:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1789050093.127568:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95073cdfea00:6678] 2 exiting: rc = 0 00000100:00100000:0.0:1789050093.127799:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127810:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127817:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127824:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127830:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127837:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127844:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127850:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127857:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127864:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127871:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127877:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127884:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127891:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127899:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127905:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127913:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127919:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127945:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127951:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127958:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127965:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127984:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.127993:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128000:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128006:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128013:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128019:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128026:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128032:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128040:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128046:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128053:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128061:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128069:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128076:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128084:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128092:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128098:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128104:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128110:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128116:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128122:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128129:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128135:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128142:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128165:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128173:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128179:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128185:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128192:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128230:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128237:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128251:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128257:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128265:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128272:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128277:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128284:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128290:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128296:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128303:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128309:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.128316:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050093.136261:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95073f380000:6680] 1 exiting: rc = 0 00000100:00100000:1.0:1789050093.136271:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95073f381000:6679] 0 exiting: rc = 1 00000100:00100000:0.0:1789050093.138460:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138471:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138478:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138484:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138489:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138495:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138501:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138508:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138513:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138519:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138524:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138530:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138536:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138542:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138548:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138553:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138559:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138565:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138570:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138575:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138581:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138586:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138592:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138597:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138619:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138624:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138630:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138635:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138641:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138646:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138652:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138658:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138664:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138857:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138871:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138880:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138887:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138896:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138905:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138974:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138983:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138989:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.138994:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139011:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139016:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139021:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139026:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139030:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139035:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139040:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139316:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139325:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139329:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139333:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139339:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139344:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139348:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139353:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139358:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.139993:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.140100:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.140108:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.140113:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050093.140124:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050093.142763:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff950710090600:6681] 0 exiting: rc = 1 00000100:00100000:3.0:1789050093.142884:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff950710090a00:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1789050093.144011:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144034:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144043:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144064:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144077:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144085:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144099:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144119:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144124:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144131:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144141:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144147:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144153:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144160:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144167:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144173:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144180:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144186:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144637:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144648:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144662:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144679:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144698:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144711:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144732:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144746:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144762:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144772:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144782:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144798:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144844:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144864:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144873:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144880:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144887:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144894:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144900:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144906:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144913:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144919:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144925:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144931:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144963:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144971:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144976:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144984:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144991:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.144996:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145002:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145008:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145014:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145020:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145026:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145031:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145067:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145074:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145081:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145087:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145093:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145099:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145105:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145111:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145117:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050093.145132:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789050093.161898:0:13305:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789050108.942483:0:13922:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789050116.959642:0:14383:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789050116.959648:0:14383:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789050116.960953:0:14383:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff950605aa8800 00000020:01000004:3.0:1789050116.960972:0:14383:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789050116.960980:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789050116.960995:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95070345cd40) 00000020:00000080:3.0:1789050116.961007:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789050116.979486:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789050116.981793:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789050116.982507:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 581: rc = 0 00100000:10000000:2.0:1789050116.982622:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 581: rc = 0 00100000:10000000:2.0:1789050116.982723:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 581: rc = 0 00100000:10000000:2.0:1789050116.982899:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 581: rc = 0 00100000:10000000:2.0:1789050116.983082:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789050116.983155:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 581: rc = 0 00100000:10000000:2.0:1789050116.983292:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 581: rc = 0 00100000:10000000:2.0:1789050116.983618:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 583: rc = 0 00100000:10000000:2.0:1789050116.984890:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 401: rc = 0 00100000:10000000:2.0:1789050116.984994:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 401: rc = 0 00100000:10000000:2.0:1789050116.985609:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.986076:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1789050116.986409:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.986754:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1789050116.987006:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1789050116.987310:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.987704:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.987998:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1789050116.988332:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1789050116.988654:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.988978:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1789050116.989321:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 769: rc = 0 00100000:10000000:2.0:1789050116.989879:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 419: rc = 0 00100000:10000000:2.0:1789050116.990126:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 419: rc = 0 00100000:10000000:2.0:1789050116.990606:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 419: rc = 0 00100000:10000000:2.0:1789050116.991190:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 419: rc = 0 00100000:10000000:2.0:1789050116.991592:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 419: rc = 0 00100000:10000000:2.0:1789050116.992176:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 419: rc = 0 00100000:10000000:2.0:1789050116.992505:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 419: rc = 0 00100000:10000000:2.0:1789050116.992879:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 419: rc = 0 00100000:10000000:2.0:1789050116.993382:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 419: rc = 0 00100000:10000000:2.0:1789050116.993803:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 419: rc = 0 00100000:10000000:2.0:1789050116.994290:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 419: rc = 0 00100000:10000000:2.0:1789050116.994516:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 419: rc = 0 00100000:10000000:2.0:1789050116.994918:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 419: rc = 0 00100000:10000000:2.0:1789050116.995521:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 419: rc = 0 00100000:10000000:2.0:1789050116.995911:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 419: rc = 0 00100000:10000000:2.0:1789050116.996361:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 419: rc = 0 00100000:10000000:2.0:1789050116.996609:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 419: rc = 0 00100000:10000000:2.0:1789050116.997141:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 419: rc = 0 00100000:10000000:2.0:1789050116.997490:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 419: rc = 0 00100000:10000000:2.0:1789050116.997854:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 419: rc = 0 00100000:10000000:2.0:1789050116.998333:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 419: rc = 0 00100000:10000000:2.0:1789050116.998597:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 419: rc = 0 00100000:10000000:2.0:1789050116.999063:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 419: rc = 0 00100000:10000000:2.0:1789050116.999362:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 419: rc = 0 00100000:10000000:2.0:1789050116.999603:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 419: rc = 0 00100000:10000000:2.0:1789050117.000044:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 419: rc = 0 00100000:10000000:2.0:1789050117.000382:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 419: rc = 0 00100000:10000000:2.0:1789050117.000614:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 419: rc = 0 00100000:10000000:2.0:1789050117.001540:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 419: rc = 0 00100000:10000000:2.0:1789050117.002189:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 419: rc = 0 00100000:10000000:2.0:1789050117.002527:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 419: rc = 0 00100000:10000000:2.0:1789050117.002891:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 419: rc = 0 00100000:10000000:2.0:1789050117.003507:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1789050117.004321:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789050117.004490:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 406: rc = 0 00100000:10000000:2.0:1789050117.004806:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789050117.004883:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 406: rc = 0 00100000:10000000:2.0:1789050117.005324:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789050117.005410:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 406: rc = 0 00100000:10000000:2.0:1789050117.005884:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789050117.005963:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 402: rc = 0 00100000:10000000:2.0:1789050117.006274:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789050117.006357:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 402: rc = 0 00100000:10000000:2.0:1789050117.006538:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789050117.006609:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 402: rc = 0 00000020:00000080:2.0:1789050117.006986:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789050117.006993:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789050117.007002:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79a34 00000020:01000004:2.0:1789050117.007010:0:14383:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789050117.007083:0:14383:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789050117.007090:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff950605aa8800 from MGS 00000020:01000004:2.0:1789050117.007093:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789050117.007104:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff950702d999c0) 00000020:00000080:2.0:1789050117.007115:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789050117.007168:0:14383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950605aa8800 from MGS, refs=2 00080000:01000000:2.0:1789050117.007173:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789050117.007177:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79a42 00000100:00100000:2.0:1789050117.007336:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789050117.007537:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789050117.007543:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789050117.008456:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789050117.008464:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789050117.009526:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050117.009886:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789050117.009891:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789050117.010473:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789050117.010481:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789050117.010931:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789050117.010938:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789050117.012038:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012042:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012044:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012395:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012397:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012399:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.012934:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789050117.019358:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789050117.027583:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789050117.027602:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789050117.027604:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789050117.030334:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789050117.030504:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789050117.030605:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789050117.031462:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789050117.031763:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789050117.031931:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789050117.031937:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789050117.036229:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789050117.036239:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789050117.036427:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789050117.036433:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789050117.038390:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789050117.038411:0:14383:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.101@tcp' 00000020:01000004:0.0:1789050117.038413:0:14383:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789050117.038443:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.101@tcp (typ=mgc) 00000020:00000080:0.0:1789050117.038454:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.101@tcp (ffff9507064019c0) 00000020:00000080:0.0:1789050117.038468:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789050117.038539:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95072f433000@MGC192.168.206.101@tcp: add connection 192.168.206.101@tcp at head 00000100:00080000:3.0:1789050117.039149:0:14397:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1789050117.040406:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.101@tcp-0 is initialized 00000040:01000000:0.0:1789050117.040415:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789050117.049319:0:14398:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789050117.049367:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.101@tcp (uuid eecacad0-cee9-47e6-a4ee-b5aef8a75ff1) 00000020:00000080:0.0:1789050117.049389:0:14383:0:(genops.c:1384:class_connect()) connect: client eecacad0-cee9-47e6-a4ee-b5aef8a75ff1, cookie 0x9df728c939b79a50 00000100:00080000:0.0:1789050117.049401:0:14383:0:(import.c:545:import_select_connection()) MGC192.168.206.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789050117.049413:0:14383:0:(import.c:666:import_select_connection()) MGC192.168.206.101@tcp: import ffff95072f433000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050117.049453:0:14383:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c577800 x1875954704137984/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050117.049484:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import eecacad0-cee9-47e6-a4ee-b5aef8a75ff1->MGS 00000020:01000004:0.0:1789050117.049501:0:14383:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789050117.049505:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789050117.049518:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff950706400000) 00000020:00000080:0.0:1789050117.049530:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789050117.049682:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3281:1875954704137984:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789050117.049753:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050117.050578:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704137984 00000100:00100000:3.0:1789050117.050586:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704137984 00000100:00100000:3.0:1789050117.050614:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050117.050621:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3281:x1875954704137984:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789050117.050641:0:14394:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from eecacad0-cee9-47e6-a4ee-b5aef8a75ff1@0@lo t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:3.0:1789050117.050814:0:14394:0:(genops.c:1384:class_connect()) connect: client eecacad0-cee9-47e6-a4ee-b5aef8a75ff1, cookie 0x9df728c939b79a5e 00000100:00080000:3.0:1789050117.050991:0:14394:0:(import.c:65:import_set_state_nolock()) ffff95073f2da000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050117.051189:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:3281:x1875954704137984:12345-0@lo:250:mount.lustre.0 Request processed in 567us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.051213:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050117.057043:0:3281:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789050117.057058:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.101@tcp: connect to target with instance 0 00000100:00080000:1.0:1789050117.057066:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789050117.057072:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789050117.057076:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95072f433000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789050117.057080:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789050117.057088:0:3281:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789050117.057096:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3281:1875954704137984:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789050117.061833:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.062322:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789050117.062328:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789050117.063506:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789050117.063516:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789050117.064133:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789050117.064141:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789050117.065452:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050117.065634:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789050117.065641:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789050117.066470:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789050117.066478:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789050117.111497:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.112125:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789050117.112132:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789050117.114393:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789050117.114405:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789050117.115417:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.115583:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789050117.115589:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789050117.118929:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789050117.118944:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789050117.120149:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.120491:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789050117.120497:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789050117.121397:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789050117.121404:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789050117.122455:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.122617:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789050117.122623:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789050117.123502:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789050117.123509:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789050117.145407:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050117.145591:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789050117.145597:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789050117.147933:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789050117.147945:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789050117.148828:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789050117.148841:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789050117.149890:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789050117.149913:0:14383:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789050117.149919:0:14383:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789050117.150056:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789050117.150088:0:14383:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789050117.150093:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789050117.150098:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050117.150100:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050117.150101:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050117.150102:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050117.150103:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050117.150104:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050117.150105:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050117.150107:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050117.150108:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789050117.150110:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789050117.150112:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789050117.150113:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050117.150114:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050117.150115:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050117.150116:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050117.150117:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050117.150118:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050117.150119:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050117.150120:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050117.150121:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789050117.150143:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789050117.150159:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789050117.150251:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.150306:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.150516:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138112 00000100:00100000:0.0:1789050117.150523:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138112 00000100:00100000:0.0:1789050117.150564:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050117.150573:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:14383:x1875954704138112:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050117.150616:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789050117.150619:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789050117.150622:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789050117.151320:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789050117.151915:0:14396:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789050117.153193:0:14418:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789050117.153227:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789050117.153231:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789050117.153266:0:14418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789050117.153637:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789050117.153658:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789050117.161295:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:14383:x1875954704138112:12345-0@lo:253:mount.lustre.0 Request processed in 10706us (11027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.161309:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050117.161423:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138112:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050117.161439:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789050117.161442:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050117.161444:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050117.161445:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050117.161446:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050117.161447:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050117.161448:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050117.161449:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050117.161450:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050117.161452:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050117.161453:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789050117.161472:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff950605aa8800 from lustre-MDT0000 10000000:01000000:1.0:1789050117.161496:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789050117.161512:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789050117.161516:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9507064019c0 10000000:01000000:1.0:1789050117.161520:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050117.161527:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9507064019c0 from 1 10000000:01000000:1.0:1789050117.161530:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789050117.161565:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.161577:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.161586:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.161605:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050117.161639:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.161892:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050117.161988:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138240 00000100:00100000:3.0:1789050117.161995:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138240 00000100:00100000:3.0:1789050117.162153:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050117.162163:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:14383:x1875954704138240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050117.162177:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050117.162191:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06600/0x9df728c939b79a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79a65 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.162254:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06600/0x9df728c939b79a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79a65 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.162266:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06600/0x9df728c939b79a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79a65 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.162276:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06600, rc 0) 00000100:00100000:3.0:1789050117.162319:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+6:14383:x1875954704138240:12345-0@lo:101:mount.lustre.0 Request processed in 158us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.162325:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050117.162417:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050117.162432:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.162441:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.162484:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050117.162513:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.162889:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010feb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.163134:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138368 00000100:00100000:0.0:1789050117.163140:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138368 00000100:00100000:0.0:1789050117.163169:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050117.163177:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+6:14383:x1875954704138368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050117.163432:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+6:14383:x1875954704138368:12345-0@lo:501:mount.lustre.0 Request processed in 254us (917us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050117.163439:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050117.163556:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789050117.163586:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789050117.163615:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.163625:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050117.163633:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff950605aa8800 10000000:01000000:1.0:1789050117.163638:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789050117.163642:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff950605aa8800 10000000:01000000:1.0:1789050117.163645:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789050117.163648:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff950605aa8800 from 1 10000000:01000000:1.0:1789050117.163662:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789050117.163937:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.163948:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.163957:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.163972:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050117.164003:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.164135:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.164310:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138496 00000100:00100000:2.0:1789050117.164316:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138496 00000100:00100000:3.0:1789050117.164374:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050117.164383:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+6:14383:x1875954704138496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050117.164399:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050117.164410:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06400/0x9df728c939b79a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79a73 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.164429:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06400/0x9df728c939b79a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79a73 expref: 7 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.164437:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06400/0x9df728c939b79a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79a73 expref: 7 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.164444:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06400, rc 0) 00000100:00100000:3.0:1789050117.164485:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+7:14383:x1875954704138496:12345-0@lo:101:mount.lustre.0 Request processed in 104us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.164492:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050117.164562:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050117.164576:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.164585:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050117.164597:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789050117.164618:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.164633:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050117.164640:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789050117.164643:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789050117.164660:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff950605aa8800 10000000:01000000:0.0:1789050117.164663:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789050117.164674:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789050117.164677:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789050117.164704:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.164712:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.164719:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050117.164734:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050117.164762:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.164781:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050117.164991:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138624 00000100:00100000:3.0:1789050117.164995:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138624 00000100:00100000:3.0:1789050117.165036:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050117.165043:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+7:14383:x1875954704138624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050117.165050:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050117.165059:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06a00/0x9df728c939b79a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79a81 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.165073:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06a00/0x9df728c939b79a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79a81 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.165081:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06a00/0x9df728c939b79a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79a81 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.165087:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:3.0:1789050117.165122:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+8:14383:x1875954704138624:12345-0@lo:101:mount.lustre.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.165129:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050117.165357:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050117.165370:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.165378:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050117.165433:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050117.165459:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.165475:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050117.165533:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138752 00000100:00100000:3.0:1789050117.165537:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138752 00000100:00100000:3.0:1789050117.165569:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050117.165576:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+8:14383:x1875954704138752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050117.166124:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14383:x1875954704138752:12345-0@lo:501:mount.lustre.0 Request processed in 547us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.166131:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050117.166379:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050117.166410:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050117.166447:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.166475:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050117.166560:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704138880 00000100:00100000:3.0:1789050117.166565:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704138880 00000100:00100000:3.0:1789050117.166597:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050117.166604:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14383:x1875954704138880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050117.167302:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14383:x1875954704138880:12345-0@lo:503:mount.lustre.0 Request processed in 697us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.167310:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789050117.167460:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704138880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050117.168112:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14419:1875954704139008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050117.168160:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.168219:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.168306:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139008 00000100:00100000:0.0:1789050117.168312:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139008 00000100:00100000:0.0:1789050117.168391:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789050117.168399:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14419:x1875954704139008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050117.168632:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14419:x1875954704139008:12345-0@lo:502:llog_process_th.0 Request processed in 234us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.168639:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050117.168862:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14419:1875954704139008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050117.168896:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.168911:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.168913:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789050117.168919:0:14419:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789050117.168922:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050117.168936:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95073d22b380) 00000020:00000080:1.0:1789050117.168953:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789050117.168958:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789050117.169028:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789050117.169036:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79a96 00000020:00000080:1.0:1789050117.169270:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789050117.169275:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.169287:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.169289:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789050117.169292:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.169295:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.169296:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789050117.169300:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050117.169307:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95073d22cd40) 00000020:00000080:1.0:1789050117.169317:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789050117.169320:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789050117.169322:0:14419:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789050117.169325:0:14419:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789050117.169330:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789050117.169368:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950605aa8800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789050117.169381:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95073d228000) 00000020:00000080:1.0:1789050117.169389:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789050117.169443:0:14419:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789050117.169448:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b79aab 00000020:00000080:1.0:1789050117.169532:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789050117.169539:0:14419:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789050117.169544:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9df728c939b79ab2 00080000:01000000:1.0:1789050117.169549:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789050117.169553:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79ab9 00010000:00010000:2.0:1789050117.267808:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789050117.269554:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967534 00000001:00080000:2.0:1789050117.269969:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789050117.271192:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff950702d9b380) 00000020:00000080:2.0:1789050117.271228:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789050117.271299:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789050117.271306:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79ac7 00000020:00000080:2.0:1789050117.272353:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789050117.279100:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9df728c939b79ace 00000020:00000080:2.0:1789050117.282499:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789050117.282514:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050117.282520:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050117.282522:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789050117.282526:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050117.282529:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789050117.282530:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050117.282531:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050117.282533:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050117.282535:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050117.282537:0:14419:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050117.282539:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050117.282542:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050117.282544:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789050117.282548:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789050117.282595:0:14419:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789050117.282617:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050117.282620:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050117.282622:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789050117.282624:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050117.282627:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789050117.282630:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050117.282637:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789050117.282640:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789050117.282645:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:2.0:1789050117.282668:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789050117.282681:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050117.282695:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff950702d9cd40) 00000020:00000080:2.0:1789050117.282710:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789050117.282716:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789050117.282770:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789050117.282776:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789050117.282782:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79adc 00010000:00080000:2.0:1789050117.282810:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950720630000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050117.289440:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789050117.297522:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050117.297572:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789050117.298813:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050117.298870:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789050117.298948:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789050117.300865:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789050117.300871:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789050117.304066:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789050117.304079:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789050117.304114:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789050117.304144:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b79ae3 00000100:00080000:3.0:1789050117.304153:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050117.304164:0:14419:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950720630000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050117.304223:0:14419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c219880 x1875954704139136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050117.304248:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789050117.304310:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050117.304314:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050117.304316:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789050117.304319:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789050117.304322:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789050117.304324:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050117.304325:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050117.304327:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789050117.304329:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050117.304330:0:14419:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789050117.304333:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050117.304336:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789050117.304339:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050117.304340:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789050117.304343:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789050117.304347:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:3.0:1789050117.304365:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789050117.304368:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050117.304379:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9507034599c0) 00000020:00000080:3.0:1789050117.304389:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789050117.304394:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789050117.304443:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789050117.304449:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789050117.304454:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b79af1 00010000:00080000:3.0:1789050117.304480:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95072f422000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050117.304696:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789050117.304865:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050117.304885:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789050117.305457:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050117.305522:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789050117.305602:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1789050117.305938:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704139136:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789050117.305990:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704139136 offset 0 length 520: 4 00000040:00080000:3.0:1789050117.309739:0:14425:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789050117.309745:0:14425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789050117.311118:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050117.311142:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789050117.311180:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789050117.311227:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b79af8 00000100:00080000:1.0:1789050117.311237:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789050117.311248:0:14419:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95072f422000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050117.311290:0:14419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee4000 x1875954704139264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050117.311312:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789050117.311369:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.311373:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.311375:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789050117.311378:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.311381:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.311383:0:14419:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789050117.311386:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789050117.311388:0:14419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789050117.311391:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.311392:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.311394:0:14419:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789050117.311396:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.311398:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.311400:0:14419:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789050117.311403:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789050117.311434:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14419:1875954704139392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050117.311508:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.311539:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.311554:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139392 00000100:00100000:2.0:1789050117.311562:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139392 00000100:00100000:2.0:1789050117.311601:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050117.311610:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14419:x1875954704139392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050117.311709:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704139264:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789050117.311748:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704139264 offset 0 length 520: 4 00000100:00100000:2.0:1789050117.311851:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14419:x1875954704139392:12345-0@lo:502:llog_process_th.0 Request processed in 241us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.311859:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050117.312007:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14419:1875954704139392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050117.312041:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050117.312046:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050117.312053:0:14419:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789050117.312057:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789050117.313875:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789050117.313903:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789050117.313918:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.313949:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050117.313957:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950605aa8800 from 1 10000000:01000000:1.0:1789050117.313959:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789050117.313993:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.314000:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.314010:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.314039:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050117.314092:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.314137:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.314193:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139520 00000100:00100000:0.0:1789050117.314227:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139520 00000100:00100000:0.0:1789050117.314271:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789050117.314289:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+9:14383:x1875954704139520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050117.314301:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050117.314315:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79aff expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.314337:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79aff expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.314346:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79aff expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.314354:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:0.0:1789050117.314394:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+10:14383:x1875954704139520:12345-0@lo:101:mount.lustre.0 Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.314400:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050117.314904:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050117.314923:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.314932:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.315524:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139648:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789050117.315570:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.317842:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.320318:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139648 00000100:00100000:2.0:1789050117.320332:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139648 00000100:00100000:2.0:1789050117.320398:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050117.320409:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+10:14383:x1875954704139648:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789050117.320435:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789050117.320441:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789050117.320555:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+10:14383:x1875954704139648:12345-0@lo:256:mount.lustre.0 Request processed in 148us (4984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.320564:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789050117.320712:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139648:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789050117.321387:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789050117.321411:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.321423:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050117.321432:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950605aa8800 from 1 10000000:01000000:1.0:1789050117.321434:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050117.321466:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.321474:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.321484:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.321503:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050117.321541:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.321567:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.321644:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139776 00000100:00100000:2.0:1789050117.321673:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139776 00000100:00100000:2.0:1789050117.321835:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050117.321845:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+10:14383:x1875954704139776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050117.322122:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050117.322141:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b0d expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050117.322163:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b0d expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050117.322173:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b0d expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050117.322180:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50800, rc 0) 00000100:00100000:2.0:1789050117.322255:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704139776:12345-0@lo:101:mount.lustre.0 Request processed in 412us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.322261:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050117.322448:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050117.322467:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.322478:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.322550:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050117.322579:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.322751:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.323084:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704139904 00000100:00100000:2.0:1789050117.323091:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704139904 00000100:00100000:2.0:1789050117.323134:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050117.323143:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704139904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050117.323527:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704139904:12345-0@lo:501:mount.lustre.0 Request processed in 385us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.323534:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050117.323595:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704139904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050117.323632:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050117.323686:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.323713:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.325155:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140032 00000100:00100000:2.0:1789050117.325165:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140032 00000100:00100000:0.0:1789050117.325332:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050117.325344:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704140032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050117.325543:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704140032:12345-0@lo:503:mount.lustre.0 Request processed in 201us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.325551:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789050117.325846:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050117.327612:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14427:1875954704140160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050117.327692:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.327722:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.327911:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140160 00000100:00100000:2.0:1789050117.327919:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140160 00000100:00100000:2.0:1789050117.327965:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050117.327983:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14427:x1875954704140160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050117.328265:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14427:x1875954704140160:12345-0@lo:502:llog_process_th.0 Request processed in 285us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.328273:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789050117.328543:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14427:1875954704140160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050117.328571:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.328580:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.328582:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789050117.328602:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950605aa8800 00000020:00000080:1.0:1789050117.328605:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050117.328612:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.328615:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.328616:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789050117.328618:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.328620:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.328621:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789050117.328624:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950605aa8800 00000020:00000080:1.0:1789050117.328627:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789050117.328687:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.328691:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.328692:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789050117.328695:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050117.328697:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.328698:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789050117.328702:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff950605aa8800 00000020:00000080:1.0:1789050117.328704:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789050117.328739:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14427:1875954704140288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050117.328773:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.328798:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.330241:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140288 00000100:00100000:0.0:1789050117.330253:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140288 00000100:00100000:0.0:1789050117.330324:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050117.330333:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14427:x1875954704140288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050117.330568:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14427:x1875954704140288:12345-0@lo:502:llog_process_th.0 Request processed in 235us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.330576:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789050117.331820:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14427:1875954704140288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050117.331857:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050117.331864:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050117.331867:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789050117.331871:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789050117.332318:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789050117.332337:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050117.332349:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.332361:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050117.332402:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789050117.332405:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff950605aa8800 10000000:01000000:0.0:1789050117.332408:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff950605aa8800 10000000:01000000:0.0:1789050117.332412:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789050117.332418:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950605aa8800 from 1 10000000:01000000:0.0:1789050117.332421:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789050117.332452:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.332461:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.332469:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050117.332487:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050117.332538:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.332575:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050117.332706:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140416 00000100:00100000:1.0:1789050117.332712:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140416 00000100:00100000:1.0:1789050117.332756:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050117.332765:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704140416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050117.332775:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050117.332787:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c530600/0x9df728c939b79b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b1b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.332806:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c530600/0x9df728c939b79b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b1b expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.332816:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c530600/0x9df728c939b79b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b1b expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.332834:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530600, rc 0) 00000100:00100000:1.0:1789050117.332876:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704140416:12345-0@lo:101:mount.lustre.0 Request processed in 113us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050117.332882:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789050117.334520:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050117.334549:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.334561:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050117.334641:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050117.334702:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.334741:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050117.336261:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140544 00000100:00100000:1.0:1789050117.336271:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140544 00000100:00100000:1.0:1789050117.336340:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050117.336351:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704140544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050117.336641:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704140544:12345-0@lo:501:mount.lustre.0 Request processed in 293us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050117.336650:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789050117.338191:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050117.338262:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050117.338332:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.338368:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff950605b96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050117.338711:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140672 00000100:00100000:1.0:1789050117.338718:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140672 00000100:00100000:1.0:1789050117.338765:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789050117.338773:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704140672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050117.338961:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704140672:12345-0@lo:503:mount.lustre.0 Request processed in 188us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050117.338969:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789050117.339150:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704140672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050117.341697:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14430:1875954704140800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050117.341767:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050117.341807:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050117.344237:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140800 00000100:00100000:2.0:1789050117.344250:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140800 00000100:00100000:2.0:1789050117.344323:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789050117.344333:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14430:x1875954704140800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050117.344625:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14430:x1875954704140800:12345-0@lo:502:llog_process_th.0 Request processed in 292us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050117.344632:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789050117.344812:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14430:1875954704140800:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789050117.344870:0:14430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789050117.344883:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff950702d98000) 00000020:00000080:2.0:1789050117.346108:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789050117.346222:0:14430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950605aa8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789050117.346228:0:14430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950605aa8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789050117.346231:0:14430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950605aa8800 4 00010000:00080000:2.0:1789050117.346273:0:14430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9507060b1000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:2.0:1789050117.357045:0:14430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789050117.357411:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789050117.357466:0:14430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789050117.357479:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9df728c939b79b30 00000100:00080000:1.0:1789050117.357489:0:14430:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789050117.357500:0:14430:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9507060b1000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050117.357533:0:14430:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee5c00 x1875954704140928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050117.357575:0:14430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789050117.358166:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704140928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050117.358251:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.358860:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704140928 00000100:00100000:1.0:1789050117.358869:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704140928 00000100:00100000:1.0:1789050117.358918:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050117.358926:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704140928:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789050117.358990:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704140928:12345-0@lo:38:llog_process_th.0 Request processed in 64us (740us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789050117.358997:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050117.359243:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050117.359251:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507060b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050117.359256:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789050117.359261:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704140928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789050117.362960:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14430:1875954704141056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050117.363051:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050117.363099:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050117.363105:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141056 00000100:00100000:0.0:1789050117.363115:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141056 00000100:00100000:0.0:1789050117.363163:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050117.363173:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14430:x1875954704141056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050117.363489:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14430:x1875954704141056:12345-0@lo:502:llog_process_th.0 Request processed in 317us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.363496:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789050117.364788:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14430:1875954704141056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789050117.364822:0:14430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789050117.365443:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789050117.365468:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789050117.365487:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050117.365505:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789050117.365552:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789050117.365554:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789050117.365556:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050117.365557:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050117.365559:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050117.365560:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050117.365562:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050117.365564:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789050117.365566:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050117.365567:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050117.365570:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789050117.365573:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050117.365575:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789050117.365576:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050117.365578:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050117.365580:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050117.365581:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050117.365594:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789050117.365596:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789050117.365598:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050117.365599:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050117.365619:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789050117.365634:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704141184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050117.365699:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050117.365735:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050117.366017:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141184 00000100:00100000:1.0:1789050117.366024:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141184 00000100:00100000:1.0:1789050117.366069:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050117.366079:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14383:x1875954704141184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050117.366115:0:14395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789050117.366128:0:14395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789050117.421453:0:14395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789050117.421472:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789050117.421533:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789050117.421538:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789050117.421559:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.421577:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79aff expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.421585:0:14417:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.421622:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050117.421648:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 12 pid: 14395 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050117.421662:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704141312:0@lo:104: 00000100:00100000:1.0:1789050117.421721:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050117.421763:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050117.423569:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141312 00000100:00100000:3.0:1789050117.423580:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141312 00000100:00100000:3.0:1789050117.423629:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050117.423637:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704141312:12345-0@lo:104: 00010000:00010000:3.0:1789050117.423652:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050117.423716:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789050117.423722:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704141312:12345-0@lo:104: Request processed in 86us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.423728:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050117.423806:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704141312:0@lo:104: 00010000:00010000:1.0:1789050117.423827:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.423961:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050117.423968:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.423976:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050117.423980:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.423988:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050117.423995:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050117.424000:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789050117.424039:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424045:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050117.424064:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424070:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530c00/0x9df728c939b79aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b06 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424089:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.424090:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050117.424103:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050117.424126:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704141440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050117.424159:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050117.424241:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141440 00000100:00100000:0.0:1789050117.424245:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141440 00010000:00010000:0.0:1789050117.424262:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 13 pid: 14395 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050117.424291:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050117.424298:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+13:3283:x1875954704141440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050117.424311:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050117.424316:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 13 pid: 14395 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424326:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 13 pid: 14395 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424339:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b79b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79aff expref: 13 pid: 14395 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424351:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424358:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789050117.424371:0:14386:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002833918s 00010000:00010000:0.0:1789050117.424376:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424383:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424395:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424402:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424408:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050117.424412:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424419:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424432:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424440:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050117.424465:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3283:x1875954704141440:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050117.424471:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050117.424496:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704141440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050117.424516:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424523:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050117.424530:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c531800/0x9df728c939b79b37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050117.431790:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14383:x1875954704141184:12345-0@lo:253:mount.lustre.0 Request processed in 65705us (66083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050117.431804:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789050117.432011:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14383:1875954704141184:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789050117.432027:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789050117.432030:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789050117.432032:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789050117.432033:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050117.432034:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050117.432035:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050117.432037:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050117.432038:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789050117.432039:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789050117.432041:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050117.432042:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789050117.432055:0:14383:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789050117.437142:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789050117.437446:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789050117.437727:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789050117.437963:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789050117.438333:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789050117.438503:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789050117.440161:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789050117.440425:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789050117.440712:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789050117.441066:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789050117.441661:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789050117.441830:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789050117.465678:0:14383:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789050117.466332:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789050117.466459:0:14439:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789050117.466463:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789050117.466651:0:14441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789050117.466717:0:14441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789050117.469649:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789050117.469773:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050117.471451:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789050117.471530:0:14441:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789050117.471535:0:14441:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1789050117.471934:0:14383:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789050117.471949:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789050117.472192:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050117.473573:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789050117.474187:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789050117.474341:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789050117.474772:0:14383:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1789050117.476194:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789050117.481807:0:14383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789050117.512795:0:14383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789050117.512829:0:14383:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa435c1463988 00100000:10000000:0.0:1789050117.512837:0:14383:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789050117.513734:0:14383:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789050117.513753:0:14383:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789050117.513767:0:14383:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789050117.513792:0:14383:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789050118.027512:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050118.414536:0:14435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050118.414546:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050118.414873:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1789050118.414880:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789050118.796934:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789050118.796941:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950605aa8800 from 6 10000000:01000000:2.0:1789050118.796946:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789050118.797003:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.797014:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.797023:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050118.797046:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704141568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050118.797115:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050118.797163:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050118.797222:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141568 00000100:00100000:1.0:1789050118.797230:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141568 00000100:00100000:1.0:1789050118.797302:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789050118.797315:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14398:x1875954704141568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050118.797326:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050118.797339:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b3e expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050118.797360:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b3e expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050118.797370:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b3e expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050118.797393:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531e00, rc 0) 00000100:00100000:1.0:1789050118.797438:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704141568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050118.797445:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050118.797709:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704141568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050118.797723:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050118.797732:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050118.797835:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704141696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050118.797867:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050118.798147:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789050118.798294:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141696 00000100:00100000:3.0:1789050118.798299:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141696 00000100:00100000:3.0:1789050118.798423:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789050118.798432:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704141696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050118.798447:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050118.798467:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050118.798470:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789050118.798560:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704141696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050118.798567:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789050118.798625:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704141696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789050118.798707:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789050118.798717:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050118.798725:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050119.053102:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050119.435841:0:14435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789050119.435854:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050119.435888:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1789050119.435894:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789050120.075319:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050121.099741:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050121.526992:0:14684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789050122.123646:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050122.387247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050122.387396:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050122.387405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050122.387409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050122.387427:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789050122.387430:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789050122.387434:0:36:0:(import.c:65:import_set_state_nolock()) ffff9507060b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050122.387468:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9507060b1000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050122.387492:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c218700 x1875954704141952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050122.387532:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704141952:0@lo:38:kworker.0 00000100:00100000:1.0:1789050122.388732:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704141824:0@lo:400:kworker.0 00000100:00100000:1.0:1789050122.391956:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050122.392915:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141824 00000100:00100000:0.0:1789050122.392925:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141824 00000100:00100000:0.0:1789050122.392982:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050122.392992:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3284:x1875954704141824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050122.393079:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3284:x1875954704141824:12345-0@lo:400:kworker.0 Request processed in 88us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050122.393086:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050122.396103:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704141824:0@lo:400:kworker.0 00000100:00100000:3.0:1789050122.400850:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050122.401145:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704141952 00000100:00100000:2.0:1789050122.401156:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704141952 00000100:00100000:2.0:1789050122.401241:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050122.401260:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704141952:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789050122.401288:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1789050122.401320:0:14403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9df728c939b79b4c 00000004:00100000:2.0:1789050122.401335:0:14403:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789050122.401479:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9507033bd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050122.401537:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875954704141952:12345-0@lo:38:kworker.0 Request processed in 288us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050122.401557:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789050122.401807:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c218700 x1875954704141952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789050122.401824:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789050122.401832:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789050122.401836:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789050122.401838:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507060b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789050122.401844:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704141952:0@lo:38:kworker.0 00010000:00010000:1.0:1789050123.149124:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789050123.962943:0:14835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff6cf6490 20000000:00000080:2.0:1789050123.962958:0:14835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950710f65c00 uarg=0000000000000000 20000000:01000000:2.0:1789050123.962991:0:14835:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789050123.962998:0:14835:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789050123.963002:0:14835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789050123.963907:0:14836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789050123.964096:0:14835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789050123.971820:0:14835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789050123.971851:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.971870:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b0d expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.971879:0:14835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.971921:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.971935:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 11 pid: 14396 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050123.971970:0:14835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1875954704142080:0@lo:104: 00000100:00100000:2.0:1789050123.972033:0:14835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050123.972123:0:14835:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ea1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050123.973899:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142080 00000100:00100000:1.0:1789050123.973910:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142080 00000100:00100000:1.0:1789050123.974004:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050123.974015:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14835:x1875954704142080:12345-0@lo:104: 00010000:00010000:1.0:1789050123.974031:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050123.974115:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050123.974122:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14835:x1875954704142080:12345-0@lo:104: Request processed in 109us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050123.974128:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789050123.974181:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050123.974188:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.974196:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789050123.974219:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.974228:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050123.974259:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050123.974265:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789050123.974298:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.974304:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050123.974324:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.974331:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79b0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b14 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.974351:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050123.974353:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050123.974438:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050123.974572:0:14835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1875954704142080:0@lo:104: 00010000:00010000:2.0:1789050123.974594:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050123.974824:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704142208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050123.974863:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050123.975911:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142208 00000100:00100000:2.0:1789050123.975920:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142208 00010000:00010000:2.0:1789050123.975949:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 12 pid: 14396 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050123.976023:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050123.976032:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3285:x1875954704142208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050123.976044:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050123.976050:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 12 pid: 14396 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976061:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 12 pid: 14396 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976077:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c50800/0x9df728c939b79b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79b0d expref: 12 pid: 14396 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976093:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976100:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976124:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976131:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976137:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976143:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976149:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050123.976153:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976161:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976181:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050123.976190:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050123.976273:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:3285:x1875954704142208:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050123.976280:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050123.976355:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704142208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050123.976445:0:14835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.976454:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050123.976461:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51e00/0x9df728c939b79b53 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050124.171745:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050125.195942:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789050125.771426:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789050125.771433:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950605aa8800 from 10 10000000:01000000:3.0:1789050125.771438:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050125.771488:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.771499:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.771510:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050125.772711:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789050125.772786:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.772906:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507102a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1789050125.773470:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142336 00000100:00100000:1.0:1789050125.773478:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142336 00000100:00100000:1.0:1789050125.773530:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050125.773539:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+11:14398:x1875954704142336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050125.773552:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050125.773568:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b5a expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050125.773591:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b5a expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050125.773601:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b5a expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050125.773609:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530800, rc 0) 00000100:00100000:1.0:1789050125.773648:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704142336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.773654:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789050125.774739:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050125.774762:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.774783:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050125.774852:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050125.774893:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050125.778626:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507102a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1789050125.779505:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142464 00000100:00100000:1.0:1789050125.779515:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142464 00000100:00100000:1.0:1789050125.779572:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789050125.779581:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704142464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050125.779841:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704142464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050125.779849:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789050125.779894:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050125.780009:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050125.780066:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050125.780106:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050125.780359:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142592 00000100:00100000:3.0:1789050125.780363:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142592 00000100:00100000:3.0:1789050125.780397:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789050125.780404:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704142592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050125.780544:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:14398:x1875954704142592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050125.780559:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050125.780700:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704142592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050125.781475:0:14915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789050125.781574:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789050125.781601:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050125.781609:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050125.781618:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050126.219804:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050127.243419:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050127.499328:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050127.499335:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050127.499338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050127.499341:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789050127.499378:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704142720:0@lo:400:kworker.0 00000100:00100000:3.0:1789050127.499448:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050127.499497:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050127.499503:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704142848:0@lo:400:kworker.0 00000100:00100000:3.0:1789050127.499532:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050127.499567:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142720 00000100:00100000:3.0:1789050127.499575:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142720 00000100:00100000:3.0:1789050127.499619:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789050127.499627:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3282:x1875954704142720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050127.499674:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:3282:x1875954704142720:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050127.499693:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789050127.499731:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704142848 00000100:00100000:3.0:1789050127.499735:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704142848 00000100:00100000:3.0:1789050127.499761:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050127.499768:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050127.499817:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704142848:12345-0@lo:400:kworker.0 Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050127.499823:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789050127.499861:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c21aa00 x1875954704142848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050127.499875:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704142848:0@lo:400:kworker.0 00000100:00100000:3.0:1789050127.499884:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704142720:0@lo:400:kworker.0 00000100:00100000:2.0:1789050127.503045:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050117/real 1789050117] req@ffff950606ee4000 x1875954704139264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050127 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050127.503074:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff950606ee4000 x1875954704139264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050127 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050127.503084:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050117/real 1789050117] req@ffff95073c219880 x1875954704139136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050127 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050127.503095:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c219880 x1875954704139136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050127 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789050127.503111:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050127.503135:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050127.503139:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704139264:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789050127.503145:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050127.503149:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050127.503152:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704139136:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789050127.503294:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050127.503300:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789050127.503303:0:38:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050127.503308:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 353 00000100:00080000:0.0:1789050127.503313:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050127.503323:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950720630000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050127.503355:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c576300 x1875954704142976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050127.503395:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050127.503398:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789050127.503400:0:38:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050127.503403:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 353 00000100:00080000:0.0:1789050127.503406:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789050127.503411:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95072f422000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050127.503425:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c577b80 x1875954704143104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050127.504072:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704142976:0@lo:8:kworker.0 00000400:00000100:2.0:1789050127.504120:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704142976 offset 0 length 520: 4 00000100:00100000:2.0:1789050127.504152:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704143104:0@lo:8:kworker.0 00000400:00000100:2.0:1789050127.504188:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704143104 offset 0 length 520: 4 00010000:00010000:3.0:1789050128.268672:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789050128.432420:0:15084:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789050128.432424:0:15084:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789050128.432548:0:15084:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff950604dbf800 00000020:01000004:2.0:1789050128.432563:0:15084:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789050128.432575:0:15084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789050128.432597:0:15084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff950704ffcd40) 00000020:00000080:2.0:1789050128.432612:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789050128.449619:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789050128.449959:0:15084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789050128.450782:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789050128.451016:0:15084:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789050128.451336:0:15084:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789050128.452005:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789050128.452102:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789050128.452241:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789050128.452734:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:3.0:1789050128.453001:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:3.0:1789050128.453396:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:3.0:1789050128.455093:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 897: rc = 0 00100000:10000000:3.0:1789050128.455462:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 897: rc = 0 00100000:10000000:3.0:1789050128.456042:0:15084:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 897: rc = 0 00000020:00000080:3.0:1789050128.457881:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789050128.457893:0:15084:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789050128.457904:0:15084:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b79b6f 00000020:01000004:3.0:1789050128.457913:0:15084:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789050128.457934:0:15084:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789050128.457938:0:15084:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789050128.457943:0:15084:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789050128.457948:0:15084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789050128.457959:0:15084:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff950703458000) 00000020:00000080:3.0:1789050128.457973:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789050128.465808:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050128.466000:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050128.466008:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789050128.466872:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789050128.466880:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789050128.467231:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789050128.467239:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789050128.468796:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050128.468968:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789050128.468974:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789050128.472154:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789050128.472165:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789050128.489968:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050128.490374:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789050128.490406:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789050128.491774:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789050128.491784:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789050128.493127:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789050128.493136:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789050128.501388:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050128.501578:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789050128.501585:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789050128.502188:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789050128.502195:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789050128.532027:0:15084:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050128.532337:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789050128.532344:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789050128.533732:0:15084:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789050128.533742:0:15084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789050128.534330:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789050128.534355:0:15084:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789050128.534361:0:15084:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789050128.543962:0:15084:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789050128.544010:0:15084:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789050128.544016:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789050128.544017:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050128.544018:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050128.544019:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050128.544020:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050128.544022:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050128.544027:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050128.544029:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050128.544030:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050128.544033:0:15084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789050128.544035:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789050128.544036:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050128.544037:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050128.544038:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050128.544039:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050128.544040:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050128.544041:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050128.544042:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050128.544043:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050128.544067:0:15084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789050128.544087:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789050128.544148:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.544195:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.544292:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143232 00000100:00100000:1.0:1789050128.544301:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143232 00000100:00100000:1.0:1789050128.544381:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050128.544390:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:15084:x1875954704143232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050128.544424:0:14394:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789050128.544428:0:14394:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789050128.544431:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789050128.556690:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:15084:x1875954704143232:12345-0@lo:253:mount.lustre.0 Request processed in 12292us (12532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.556703:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050128.556902:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050128.556916:0:15084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789050128.556920:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050128.556921:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050128.556922:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050128.556924:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050128.556925:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050128.556926:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050128.556928:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050128.556930:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050128.556931:0:15084:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789050128.556947:0:15084:0:(tgt_mount.c:101:server_register_mount()) register mount ffff950604dbf800 from lustre-OST0000 10000000:01000000:1.0:1789050128.556985:0:15084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789050128.556987:0:15084:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789050128.556994:0:15084:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9507064019c0 local copy 00010000:00010000:1.0:1789050128.557013:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.557261:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050128.557297:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.557328:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050128.557473:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143360 00000100:00100000:3.0:1789050128.557479:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143360 00000100:00100000:3.0:1789050128.557525:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789050128.557535:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:15084:x1875954704143360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050128.557689:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:15084:x1875954704143360:12345-0@lo:501:mount.lustre.0 Request processed in 155us (390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050128.557697:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050128.558426:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143360:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789050128.558445:0:15084:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789050128.558623:0:15084:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789050128.558738:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.558750:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050128.558777:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff950604dbf800 10000000:01000000:1.0:1789050128.558782:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789050128.558787:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9507064019c0 10000000:01000000:1.0:1789050128.558800:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789050128.558803:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9507064019c0 from 1 10000000:01000000:1.0:1789050128.558806:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789050128.558833:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.558841:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.558863:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.558879:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050128.558917:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.558947:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050128.559160:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143488 00000100:00100000:3.0:1789050128.559166:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143488 00000100:00100000:3.0:1789050128.559247:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789050128.559257:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+12:15084:x1875954704143488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050128.559268:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050128.559282:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06000/0x9df728c939b79b84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b7d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.559303:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06000/0x9df728c939b79b84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b7d expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.559313:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06000/0x9df728c939b79b84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b7d expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.559321:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06000, rc 0) 00000100:00100000:3.0:1789050128.559355:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+13:15084:x1875954704143488:12345-0@lo:101:mount.lustre.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.559362:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050128.559489:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050128.559502:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.559511:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050128.559526:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789050128.559541:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.559548:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050128.559555:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789050128.559559:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050128.559563:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789050128.559565:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789050128.559580:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.559587:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.559726:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.559742:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050128.559767:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.559892:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.562769:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143616 00000100:00100000:2.0:1789050128.562783:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143616 00000100:00100000:2.0:1789050128.562862:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050128.562873:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+13:15084:x1875954704143616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050128.562891:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050128.562909:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51a00/0x9df728c939b79b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79b8b expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.562937:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51a00/0x9df728c939b79b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79b8b expref: 14 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.562949:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51a00/0x9df728c939b79b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b8b expref: 14 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.562958:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51a00, rc 0) 00000100:00100000:2.0:1789050128.563378:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704143616:12345-0@lo:101:mount.lustre.0 Request processed in 506us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.563386:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789050128.563485:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050128.563503:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.563514:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050128.564478:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789050128.566137:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050128.566715:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789050128.566768:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789050128.566946:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789050128.567002:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789050128.567126:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789050128.567162:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789050128.567306:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789050128.567316:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789050128.567398:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050128.567456:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.569461:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050128.569531:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143744 00000100:00100000:3.0:1789050128.569540:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143744 00000100:00100000:3.0:1789050128.569646:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789050128.569657:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704143744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050128.570350:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704143744:12345-0@lo:501:mount.lustre.0 Request processed in 694us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.570359:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789050128.570468:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050128.570520:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050128.570568:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.571230:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.571327:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704143872 00000100:00100000:1.0:1789050128.571334:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704143872 00000100:00100000:1.0:1789050128.571380:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789050128.571389:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704143872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050128.571743:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704143872:12345-0@lo:503:mount.lustre.0 Request processed in 354us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.571750:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789050128.571949:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704143872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789050128.572860:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789050128.572940:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050128.572999:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.573030:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.573773:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144000 00000100:00100000:1.0:1789050128.573781:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144000 00000100:00100000:1.0:1789050128.573829:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789050128.573839:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704144000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.574255:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704144000:12345-0@lo:502:mount.lustre.0 Request processed in 417us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.574262:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789050128.574370:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050128.574575:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789050128.574908:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789050128.574940:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789050128.575076:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789050128.575114:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789050128.575141:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789050128.575190:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789050128.575311:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789050128.575340:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789050128.575378:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789050128.575419:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789050128.575458:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789050128.575489:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050128.575534:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.575571:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.575786:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144128 00000100:00100000:1.0:1789050128.575853:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144128 00000100:00100000:1.0:1789050128.575895:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050128.575903:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704144128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.576136:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704144128:12345-0@lo:502:mount.lustre.0 Request processed in 233us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.576144:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789050128.576298:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050128.576365:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789050128.576374:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789050128.577983:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050128.577993:0:15098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789050128.578000:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050128.578076:0:15098:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789050128.578086:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050128.578547:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95070345b380) 00000020:00000080:3.0:1789050128.578580:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789050128.578588:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789050128.579972:0:15098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950604dbf800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789050128.579985:0:15098:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789050128.579992:0:15098:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b79ba0 00010000:00010000:3.0:1789050128.586665:0:15098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789050128.589123:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789050128.591860:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789050128.594243:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789050128.594254:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050128.594261:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594263:0:15098:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789050128.594277:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050128.594279:0:15098:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789050128.594281:0:15098:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050128.594282:0:15098:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050128.594284:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050128.594286:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594288:0:15098:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050128.594291:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050128.594294:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594295:0:15098:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789050128.594298:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789050128.594300:0:15098:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789050128.594302:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050128.594304:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594305:0:15098:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789050128.594308:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050128.594310:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594311:0:15098:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789050128.594314:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789050128.594376:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050128.594380:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050128.594382:0:15098:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789050128.594385:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789050128.598494:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789050128.598537:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789050128.598555:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.598568:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050128.598577:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950604dbf800 from 1 10000000:01000000:3.0:1789050128.598579:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050128.598615:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.598623:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.598633:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050128.598656:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050128.598716:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050128.598757:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950702d10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.599341:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144256 00000100:00100000:2.0:1789050128.599349:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144256 00000100:00100000:2.0:1789050128.599394:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789050128.599405:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:15084:x1875954704144256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050128.599419:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050128.599431:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79ba7 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.599454:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 15 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.599479:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 15 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050128.599488:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51800, rc 0) 00000100:00100000:2.0:1789050128.599584:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144256:12345-0@lo:101:mount.lustre.0 Request processed in 182us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.599592:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050128.599773:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050128.599868:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.599879:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050128.602727:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789050128.603574:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050128.603955:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789050128.604005:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789050128.604068:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789050128.604077:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789050128.604156:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050128.606715:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.606765:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050128.606782:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144384 00000100:00100000:3.0:1789050128.606852:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144384 00000100:00100000:3.0:1789050128.606963:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789050128.606973:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050128.607252:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144384:12345-0@lo:501:mount.lustre.0 Request processed in 280us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.607260:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789050128.607345:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050128.607389:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050128.607437:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.607467:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.607523:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144512 00000100:00100000:2.0:1789050128.607528:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144512 00000100:00100000:2.0:1789050128.607562:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789050128.607569:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050128.607901:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144512:12345-0@lo:503:mount.lustre.0 Request processed in 332us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.607908:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050128.607978:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789050128.608631:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789050128.608695:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050128.608740:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.608772:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789050128.608886:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144640 00000100:00100000:3.0:1789050128.608892:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144640 00000100:00100000:3.0:1789050128.608928:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050128.608936:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050128.609098:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144640:12345-0@lo:502:mount.lustre.0 Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050128.609105:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789050128.609294:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050128.609530:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789050128.609580:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789050128.609627:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789050128.609781:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789050128.609891:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789050128.609938:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789050128.609976:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789050128.610012:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789050128.610041:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050128.610083:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.610167:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.610330:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144768 00000100:00100000:2.0:1789050128.610336:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144768 00000100:00100000:2.0:1789050128.610409:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789050128.610418:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050128.610578:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144768:12345-0@lo:502:mount.lustre.0 Request processed in 160us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.610585:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789050128.610659:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789050128.610739:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789050128.610756:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789050128.611614:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050128.611623:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611635:0:15102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789050128.611642:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950604dbf800 00000020:00000080:0.0:1789050128.611645:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050128.611651:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050128.611654:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611655:0:15102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789050128.611658:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050128.611660:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611661:0:15102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789050128.611664:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950604dbf800 00000020:00000080:0.0:1789050128.611666:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050128.611721:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050128.611725:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611727:0:15102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789050128.611729:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050128.611732:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611733:0:15102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050128.611737:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff950604dbf800 00000020:00000080:0.0:1789050128.611739:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050128.611776:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050128.611780:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050128.611781:0:15102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050128.611784:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789050128.618744:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789050128.618781:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050128.618807:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.618820:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050128.618887:0:15084:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789050128.618890:0:15084:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff950604dbf800 10000000:01000000:1.0:1789050128.618893:0:15084:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff950604dbf800 10000000:01000000:1.0:1789050128.618897:0:15084:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050128.618903:0:15084:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950604dbf800 from 1 10000000:01000000:1.0:1789050128.618906:0:15084:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789050128.618941:0:15084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.618951:0:15084:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.618961:0:15084:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050128.618985:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050128.619049:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.619089:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704144896 00000100:00100000:1.0:1789050128.619096:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704144896 00000100:00100000:1.0:1789050128.619138:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050128.619147:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704144896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050128.619158:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050128.619170:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c531a00/0x9df728c939b79bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79bb5 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.619189:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c531a00/0x9df728c939b79bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79bb5 expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.619244:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c531a00/0x9df728c939b79bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79bb5 expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.619252:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531a00, rc 0) 00000100:00100000:1.0:1789050128.619285:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704144896:12345-0@lo:101:mount.lustre.0 Request processed in 139us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.619291:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050128.619334:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c520540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.619354:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704144896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050128.619370:0:15084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.619379:0:15084:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050128.619920:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789050128.620582:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050128.620845:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789050128.620889:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789050128.620927:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789050128.620976:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789050128.621014:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789050128.626459:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789050128.626523:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789050128.626559:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789050128.626601:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789050128.628922:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789050128.629012:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789050128.629109:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789050128.629148:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789050128.629183:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789050128.629268:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789050128.629299:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789050128.629325:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789050128.629361:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789050128.629388:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789050128.629414:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789050128.629449:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789050128.629476:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789050128.629520:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789050128.629559:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789050128.629586:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789050128.629614:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789050128.632115:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789050128.632168:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789050128.633624:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789050128.633774:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789050128.633955:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050128.634017:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.634065:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c520540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050128.634758:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145024 00000100:00100000:2.0:1789050128.634767:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145024 00000100:00100000:2.0:1789050128.634824:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050128.634835:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050128.635083:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145024:12345-0@lo:501:mount.lustre.0 Request processed in 249us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.635097:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789050128.635298:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050128.635337:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050128.635381:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.635408:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145152 00000100:00100000:1.0:1789050128.635413:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145152 00000100:00100000:1.0:1789050128.635440:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789050128.635447:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050128.635590:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145152:12345-0@lo:503:mount.lustre.0 Request processed in 144us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.635598:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789050128.636318:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c520540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.636338:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050128.638280:0:15084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050128.638366:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.638439:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.638478:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145280 00000100:00100000:1.0:1789050128.638484:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145280 00000100:00100000:1.0:1789050128.638522:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789050128.638531:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.639075:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145280:12345-0@lo:502:mount.lustre.0 Request processed in 544us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.639084:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789050128.639131:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95071192c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.639150:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050128.639478:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789050128.639529:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789050128.639561:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789050128.639605:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789050128.640959:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789050128.641047:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789050128.641105:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789050128.641140:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789050128.641192:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789050128.641270:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789050128.641319:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789050128.641371:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789050128.641410:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789050128.641446:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789050128.641496:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789050128.641535:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789050128.641572:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789050128.643877:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789050128.643976:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789050128.644015:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789050128.644076:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789050128.644114:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789050128.644167:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789050128.644264:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789050128.644306:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789050128.644344:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789050128.644408:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789050128.644449:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789050128.644480:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789050128.644521:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789050128.644551:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789050128.644579:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789050128.644607:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789050128.645760:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789050128.646350:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789050128.646407:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789050128.646443:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789050128.646475:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789050128.646537:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789050128.646576:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789050128.646625:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.647348:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050128.647444:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95071192c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050128.651407:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145408 00000100:00100000:0.0:1789050128.651422:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145408 00000100:00100000:1.0:1789050128.653982:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050128.653996:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050128.654314:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145408:12345-0@lo:502:mount.lustre.0 Request processed in 320us (6966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.654323:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050128.654398:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050128.654508:0:15084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789050128.654522:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789050128.659340:0:15107:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789050128.659360:0:15107:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95073d2299c0) 00000020:00000080:1.0:1789050128.659381:0:15107:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789050128.659473:0:15107:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950604dbf800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789050128.659478:0:15107:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950604dbf800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789050128.659480:0:15107:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604dbf800 3 00010000:00080000:1.0:1789050128.659510:0:15107:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9506046d0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.101@tcp at head 00010000:00010000:1.0:1789050128.663262:0:15107:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789050128.663458:0:15107:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789050128.663498:0:15107:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789050128.663510:0:15107:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9df728c939b79bca 00000100:00080000:1.0:1789050128.663520:0:15107:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789050128.663531:0:15107:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9506046d0000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050128.663565:0:15107:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee7100 x1875954704145536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050128.663589:0:15107:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789050128.663621:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050128.663625:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050128.663645:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050128.663648:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050128.663690:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050128.663703:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704145664:0@lo:400:kworker.0 00000100:00100000:1.0:1789050128.663765:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.666030:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704145536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050128.666095:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.666175:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145664 00000100:00100000:0.0:1789050128.666182:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145664 00000100:00100000:0.0:1789050128.666245:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145536 00000100:00100000:0.0:1789050128.666256:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145536 00000100:00100000:0.0:1789050128.666273:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050128.666282:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704145664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050128.666336:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704145664:12345-0@lo:400:kworker.0 Request processed in 55us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.666343:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050128.666360:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050128.666364:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704145536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789050128.666385:0:14401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:0.0:1789050128.666418:0:14401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9df728c939b79bd1 00000004:00100000:0.0:1789050128.666432:0:14401:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789050128.666459:0:14401:0:(import.c:65:import_set_state_nolock()) ffff95073d236000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050128.666496:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875954704145536:12345-0@lo:38:llog_process_th.0 Request processed in 131us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.666503:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789050128.666538:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff950606ee7100 x1875954704145536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050128.666548:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050128.666556:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789050128.666562:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789050128.666567:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789050128.666569:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9506046d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050128.666574:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704145536:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789050128.667803:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff950606ee4000 x1875954704145664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050128.667819:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704145664:0@lo:400:kworker.0 00000040:00080000:1.0:1789050128.676304:0:15107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789050128.676451:0:15084:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789050128.676476:0:15084:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789050128.676596:0:15084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.676619:0:15084:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789050128.676677:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789050128.676680:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050128.676681:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050128.676682:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050128.676683:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050128.676685:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050128.676687:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050128.676688:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050128.676690:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789050128.676693:0:15084:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789050128.676696:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789050128.676697:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050128.676698:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050128.676699:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050128.676700:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050128.676701:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050128.676702:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050128.676703:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050128.676704:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789050128.676729:0:15084:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789050128.676748:0:15084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789050128.676822:0:15084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.676856:0:15084:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050128.677382:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145792 00000100:00100000:0.0:1789050128.677390:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145792 00000100:00100000:0.0:1789050128.677446:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789050128.677455:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15084:x1875954704145792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050128.677494:0:14395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789050128.677508:0:14395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789050128.707380:0:14395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789050128.707397:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789050128.707491:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789050128.707496:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789050128.707516:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.707533:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b3e expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.707540:0:14417:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.707576:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.707588:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 16 pid: 14394 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.707601:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704145920:0@lo:104: 00000100:00100000:0.0:1789050128.707734:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.707823:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050128.709651:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704145920 00000100:00100000:1.0:1789050128.709664:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704145920 00000100:00100000:1.0:1789050128.709717:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050128.709727:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704145920:12345-0@lo:104: 00010000:00010000:1.0:1789050128.709743:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709827:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050128.709834:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704145920:12345-0@lo:104: Request processed in 109us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050128.709842:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789050128.709862:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050128.709867:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709875:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050128.709892:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709901:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050128.709908:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050128.709914:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789050128.709946:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709954:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050128.709971:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709978:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50400/0x9df728c939b79b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b45 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050128.709993:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050128.709994:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050128.709996:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050128.710014:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704146048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050128.710049:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050128.710268:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146048 00000100:00100000:0.0:1789050128.710273:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146048 00010000:00010000:0.0:1789050128.710292:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 17 pid: 14394 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050128.710318:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050128.710324:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:3285:x1875954704146048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050128.710334:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050128.710338:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 17 pid: 14394 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710358:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 17 pid: 14394 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710375:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710383:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789050128.710396:0:14388:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002901341s 00010000:00010000:0.0:1789050128.710401:0:14388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710408:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710415:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710421:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710426:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050128.710430:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710436:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710444:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050128.710461:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050128.710494:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:3285:x1875954704146048:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050128.710501:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050128.710537:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704146048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050128.710664:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c531e00/0x9df728c939b79b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79b3e expref: 16 pid: 14394 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050128.710676:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704145920:0@lo:104: 00010000:00010000:3.0:1789050128.710690:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.710699:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.710705:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050128.710710:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331600/0x9df728c939b79bd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050128.719612:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:15084:x1875954704145792:12345-0@lo:253:mount.lustre.0 Request processed in 42149us (42781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050128.719627:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789050128.719736:0:15084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15084:1875954704145792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050128.719751:0:15084:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789050128.719755:0:15084:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050128.719757:0:15084:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050128.719758:0:15084:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050128.719771:0:15084:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050128.719772:0:15084:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050128.719774:0:15084:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050128.719775:0:15084:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050128.719777:0:15084:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050128.719778:0:15084:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789050128.719800:0:15084:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789050128.724882:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050128.725054:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050128.725327:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050128.725484:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050128.725652:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050128.725881:0:15084:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789050128.726757:0:15084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789050128.776528:0:15084:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789050128.776536:0:15084:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789050128.776570:0:15084:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789050128.776638:0:15084:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789050128.776658:0:15084:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789050128.776686:0:15084:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789050129.296976:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050129.682242:0:14435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789050129.682260:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050129.682662:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789050129.682812:0:14435:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050129.682843:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1789050130.315467:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789050130.316281:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789050130.316286:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950605aa8800 from 7 10000000:01000000:1.0:1789050130.316291:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789050130.316333:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.316344:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050130.316355:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050130.316394:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704146176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050130.316474:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050130.316534:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070642d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050130.316932:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146176 00000100:00100000:0.0:1789050130.316949:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146176 00000100:00100000:0.0:1789050130.317005:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050130.317013:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:14398:x1875954704146176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050130.317025:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050130.317039:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79bdf expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.317061:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79bdf expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.317072:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79bdf expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050130.317080:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331e00, rc 0) 00000100:00100000:0.0:1789050130.317133:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:14398:x1875954704146176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050130.317139:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789050130.317251:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704146176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050130.317266:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.317274:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050130.317328:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704146304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050130.317374:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050130.317396:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050130.317628:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146304 00000100:00100000:1.0:1789050130.317633:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146304 00000100:00100000:1.0:1789050130.317667:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789050130.317675:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:14398:x1875954704146304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789050130.317688:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789050130.317703:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789050130.317706:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789050130.317778:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:14398:x1875954704146304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050130.317795:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789050130.317974:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704146304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789050130.318032:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789050130.318039:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050130.318048:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050131.347968:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050132.364996:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050133.387458:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050134.169978:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050134.169984:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050134.169987:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050134.169990:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789050134.170043:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704146432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050134.170107:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050134.170159:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050134.170165:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704146560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050134.170221:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050134.171767:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146432 00000100:00100000:1.0:1789050134.171921:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146432 00000100:00100000:0.0:1789050134.172047:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704146688:0@lo:400:kworker.0 00000100:00100000:1.0:1789050134.172079:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789050134.172091:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:3282:x1875954704146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050134.172105:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050134.172156:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146560 00000100:00100000:1.0:1789050134.172159:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:3282:x1875954704146432:12345-0@lo:400:kworker.0 Request processed in 70us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050134.172168:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789050134.172170:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146560 00000100:00100000:0.0:1789050134.172235:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146688 00000100:00100000:0.0:1789050134.172238:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146688 00000100:00100000:1.0:1789050134.172248:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704146432:0@lo:400:kworker.0 00000100:00100000:0.0:1789050134.172265:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050134.172273:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704146560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050134.172311:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704146560:12345-0@lo:400:kworker.0 Request processed in 39us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.172317:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050134.172331:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050134.172338:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704146688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050134.172367:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704146688:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050134.172373:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789050134.172412:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789050134.172433:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c21b100 x1875954704146560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050134.172445:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704146560:0@lo:400:kworker.0 00010000:00080000:0.0:1789050134.172465:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c219500 x1875954704146688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050134.172474:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704146688:0@lo:400:kworker.0 00010000:00010000:3.0:1789050134.411389:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789050134.905745:0:15452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789050135.440465:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050136.460341:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050137.488861:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050138.507926:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050139.276651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050139.276657:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050139.276660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050139.276663:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789050139.279433:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704146816:0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.279518:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050139.279589:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704147072:0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.279620:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050139.279649:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050139.279656:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704146944:0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.279677:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050139.279705:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146816 00000100:00100000:3.0:1789050139.279713:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146816 00000100:00100000:3.0:1789050139.279763:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789050139.279784:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:3285:x1875954704146816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.279833:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:3285:x1875954704146816:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050139.279841:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789050139.279872:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147072 00000100:00100000:3.0:1789050139.279875:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147072 00000100:00100000:3.0:1789050139.279906:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704146944 00000100:00100000:3.0:1789050139.279909:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704146944 00000100:00100000:3.0:1789050139.279921:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050139.279927:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704147072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.279960:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704147072:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050139.279965:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050139.279976:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050139.279981:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704146944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.280007:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704146944:12345-0@lo:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050139.280012:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789050139.280040:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789050139.280068:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c57a680 x1875954704146944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050139.280082:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704146944:0@lo:400:kworker.0 00010000:00080000:3.0:1789050139.280092:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c578e00 x1875954704147072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050139.280101:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704147072:0@lo:400:kworker.0 00000100:00100000:3.0:1789050139.280141:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704146816:0@lo:400:kworker.0 00010000:00010000:3.0:1789050139.532349:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050139.915763:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789050140.561706:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050141.579438:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789050142.554814:0:15802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789050142.554818:0:15802:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789050142.554950:0:15802:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff950604d74800 00000020:01000004:3.0:1789050142.554965:0:15802:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789050142.554977:0:15802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789050142.555000:0:15802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9507044219c0) 00000020:00000080:3.0:1789050142.555016:0:15802:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789050142.572023:0:15802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789050142.572338:0:15802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789050142.573103:0:15802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789050142.573785:0:15802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789050142.574960:0:15802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789050142.575494:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 591: rc = 0 00100000:10000000:2.0:1789050142.575647:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 591: rc = 0 00100000:10000000:2.0:1789050142.575760:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 591: rc = 0 00100000:10000000:2.0:1789050142.576183:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 13: rc = 0 00100000:10000000:2.0:1789050142.576557:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 13: rc = 0 00100000:10000000:2.0:1789050142.576801:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 13: rc = 0 00100000:10000000:2.0:1789050142.577039:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 13: rc = 0 00100000:10000000:2.0:1789050142.578686:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 13: rc = 0 00100000:10000000:2.0:1789050142.579105:0:15802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 13: rc = 0 00000020:00000080:2.0:1789050142.579945:0:15802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789050142.579956:0:15802:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789050142.579966:0:15802:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b79bf4 00000020:01000004:2.0:1789050142.579973:0:15802:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789050142.579992:0:15802:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789050142.579995:0:15802:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789050142.580000:0:15802:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789050142.580025:0:15802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789050142.580028:0:15802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789050142.588760:0:15802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789050142.588795:0:15802:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.101@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789050142.588800:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789050142.588802:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.588803:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.588804:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.588805:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.588806:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.588808:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.588810:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.588811:0:15802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050142.588814:0:15802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789050142.588816:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050142.588818:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.588819:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.588820:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.588821:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.588822:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.588823:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.588824:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.588825:0:15802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789050142.588860:0:15802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789050142.588879:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050142.588946:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.589073:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070a979840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.589188:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147200 00000100:00100000:3.0:1789050142.589196:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147200 00000100:00100000:2.0:1789050142.589734:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050142.589744:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15802:x1875954704147200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789050142.589773:0:14394:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789050142.589777:0:14394:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789050142.589780:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789050142.598891:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15802:x1875954704147200:12345-0@lo:253:mount.lustre.0 Request processed in 9140us (9936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.598905:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050142.599002:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050142.599017:0:15802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789050142.599032:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050142.599034:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.599035:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.599036:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.599037:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.599038:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.599040:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.599041:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.599043:0:15802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789050142.599060:0:15802:0:(tgt_mount.c:101:server_register_mount()) register mount ffff950604d74800 from lustre-OST0001 10000000:01000000:2.0:1789050142.599082:0:15802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789050142.599085:0:15802:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789050142.599091:0:15802:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9507064019c0 local copy 00010000:00010000:2.0:1789050142.599101:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050142.599389:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050142.599423:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.599556:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050142.599597:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147328 00000100:00100000:1.0:1789050142.599604:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147328 00000100:00100000:1.0:1789050142.599678:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789050142.599688:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15802:x1875954704147328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050142.599896:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15802:x1875954704147328:12345-0@lo:501:mount.lustre.0 Request processed in 209us (472us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789050142.599904:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789050142.600023:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789050142.600035:0:15802:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 00010000:00010000:0.0:1789050142.603692:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789050142.604066:0:15802:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789050142.604075:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050142.604086:0:15802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050142.604117:0:15802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff950604d74800 10000000:01000000:2.0:1789050142.604125:0:15802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789050142.604130:0:15802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789050142.604154:0:15802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789050142.604160:0:15802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789050142.604163:0:15802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789050142.604229:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050142.604239:0:15802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050142.604248:0:15802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050142.604271:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050142.604327:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.604366:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.604429:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147456 00000100:00100000:3.0:1789050142.604436:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147456 00000100:00100000:3.0:1789050142.604494:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050142.604502:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:15802:x1875954704147456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050142.604514:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050142.604524:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06e00/0x9df728c939b79c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79bfb expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.604546:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06e00/0x9df728c939b79c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79bfb expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.604555:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06e00/0x9df728c939b79c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79bfb expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.604573:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06e00, rc 0) 00000100:00100000:3.0:1789050142.604608:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147456:12345-0@lo:101:mount.lustre.0 Request processed in 107us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.604614:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789050142.604760:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050142.604773:0:15802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050142.604782:0:15802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050142.605457:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789050142.606919:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050142.607187:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789050142.608006:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789050142.608062:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789050142.608118:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789050142.608167:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789050142.608857:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789050142.608959:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789050142.608968:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789050142.609063:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050142.609124:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.609266:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728e1bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.611328:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147584 00000100:00100000:3.0:1789050142.611342:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147584 00000100:00100000:3.0:1789050142.611432:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050142.611452:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050142.612368:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147584:12345-0@lo:501:mount.lustre.0 Request processed in 915us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.612376:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789050142.612483:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050142.612530:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050142.612575:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.624413:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147712 00000100:00100000:2.0:1789050142.624428:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147712 00000100:00100000:2.0:1789050142.624495:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789050142.624504:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050142.625578:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050142.625966:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147712:12345-0@lo:503:mount.lustre.0 Request processed in 1461us (13389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050142.625977:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789050142.626128:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050142.626744:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050142.626818:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050142.626866:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.626901:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.627096:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147840 00000100:00100000:3.0:1789050142.627103:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147840 00000100:00100000:3.0:1789050142.627154:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789050142.627163:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050142.627379:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147840:12345-0@lo:502:mount.lustre.0 Request processed in 217us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.627386:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789050142.627634:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050142.627934:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789050142.627984:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789050142.628020:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789050142.628069:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789050142.628109:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789050142.628156:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789050142.628523:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789050142.628567:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789050142.628618:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789050142.628648:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050142.628695:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.628818:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070a979840 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.635393:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704147968 00000100:00100000:3.0:1789050142.635407:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704147968 00000100:00100000:3.0:1789050142.635818:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789050142.635829:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050142.636092:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704147968:12345-0@lo:502:mount.lustre.0 Request processed in 264us (7395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.636100:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050142.636289:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704147968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050142.636402:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789050142.636418:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789050142.638009:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050142.638018:0:15803:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789050142.638025:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050142.638034:0:15803:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789050142.638041:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050142.638055:0:15803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff950704ff99c0) 00000020:00000080:2.0:1789050142.638075:0:15803:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789050142.638081:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789050142.638163:0:15803:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950604d74800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789050142.638183:0:15803:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789050142.638191:0:15803:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b79c10 00010000:00010000:3.0:1789050142.649301:0:15803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789050142.652521:0:15803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789050142.656791:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789050142.660244:0:15803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789050142.660256:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.660263:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.660266:0:15803:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789050142.660269:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050142.660272:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.660274:0:15803:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789050142.660276:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789050142.660278:0:15803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789050142.660281:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.660283:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.660284:0:15803:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789050142.660286:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050142.660287:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.660289:0:15803:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789050142.660291:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789050142.660347:0:15803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.660350:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.660352:0:15803:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789050142.660355:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789050142.660502:0:15802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789050142.660525:0:15802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789050142.660550:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.660561:0:15802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050142.660569:0:15802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950604d74800 from 1 10000000:01000000:1.0:1789050142.660571:0:15802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050142.660602:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.660610:0:15802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.660634:0:15802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050142.660657:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050142.660725:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.660762:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77900 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.665121:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148096 00000100:00100000:0.0:1789050142.665136:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148096 00000100:00100000:0.0:1789050142.665232:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789050142.665242:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:15802:x1875954704148096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050142.665256:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050142.665275:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79c17 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.665301:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.665312:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.665339:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:0.0:1789050142.665407:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148096:12345-0@lo:101:mount.lustre.0 Request processed in 166us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.665414:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789050142.665599:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050142.665616:0:15802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.665624:0:15802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050142.666119:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789050142.666585:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050142.666793:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789050142.666839:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789050142.666901:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789050142.666909:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789050142.666970:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050142.667016:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.667059:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77900 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.667125:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148224 00000100:00100000:3.0:1789050142.667132:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148224 00000100:00100000:3.0:1789050142.667186:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789050142.667194:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050142.667414:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148224:12345-0@lo:501:mount.lustre.0 Request processed in 220us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.667421:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789050142.667461:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050142.667491:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050142.667528:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.667546:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.667559:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148352 00000100:00100000:3.0:1789050142.667563:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148352 00000100:00100000:3.0:1789050142.667584:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050142.667589:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050142.667944:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148352:12345-0@lo:503:mount.lustre.0 Request processed in 353us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.667951:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789050142.667992:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050142.669150:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050142.669233:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050142.669280:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.669302:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.669814:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148480 00000100:00100000:3.0:1789050142.669875:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148480 00000100:00100000:3.0:1789050142.669916:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789050142.669925:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050142.670107:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148480:12345-0@lo:502:mount.lustre.0 Request processed in 183us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.670115:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789050142.670181:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050142.671432:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789050142.671499:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789050142.671557:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789050142.671593:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789050142.671627:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789050142.671675:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789050142.671936:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789050142.671971:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789050142.672012:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050142.672086:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.672184:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.672614:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148608 00000100:00100000:0.0:1789050142.672621:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148608 00000100:00100000:0.0:1789050142.672759:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789050142.672768:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050142.672979:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148608:12345-0@lo:502:mount.lustre.0 Request processed in 212us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.672986:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789050142.673175:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050142.673304:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789050142.673317:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789050142.680664:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050142.680686:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.680689:0:15807:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789050142.680702:0:15807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950604d74800 00000020:00000080:0.0:1789050142.680705:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050142.680711:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.680714:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.680715:0:15807:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789050142.680718:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050142.680720:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.680722:0:15807:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789050142.680725:0:15807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950604d74800 00000020:00000080:0.0:1789050142.680727:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050142.680793:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.680797:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.680799:0:15807:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789050142.680801:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050142.680804:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.680810:0:15807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050142.680814:0:15807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff950604d74800 00000020:00000080:0.0:1789050142.681092:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050142.681136:0:15807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050142.681150:0:15807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050142.681152:0:15807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050142.681155:0:15807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789050142.681230:0:15802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789050142.681256:0:15802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050142.681269:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.681280:0:15802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050142.681316:0:15802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789050142.681319:0:15802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff950604d74800 10000000:01000000:1.0:1789050142.681323:0:15802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff950604d74800 10000000:01000000:1.0:1789050142.681327:0:15802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050142.681332:0:15802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950604d74800 from 1 10000000:01000000:1.0:1789050142.681335:0:15802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789050142.681374:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.681382:0:15802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.681393:0:15802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050142.681416:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050142.681486:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.681526:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.682194:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148736 00000100:00100000:0.0:1789050142.682233:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148736 00000100:00100000:0.0:1789050142.682273:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789050142.682282:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704148736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050142.682295:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050142.682309:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330600/0x9df728c939b79c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79c25 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.682391:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330600/0x9df728c939b79c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79c25 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.682402:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330600/0x9df728c939b79c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79c25 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.682409:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:0.0:1789050142.682464:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704148736:12345-0@lo:101:mount.lustre.0 Request processed in 183us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.682470:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789050142.682541:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050142.682556:0:15802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.682564:0:15802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050142.683299:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789050142.685395:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050142.685873:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789050142.685921:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789050142.685955:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789050142.686098:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789050142.686164:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789050142.686367:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789050142.686408:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789050142.687016:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789050142.687076:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789050142.687110:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789050142.687152:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789050142.687231:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789050142.687268:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789050142.687301:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789050142.687347:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789050142.687384:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789050142.687417:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789050142.687475:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789050142.687511:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789050142.687543:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789050142.687603:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789050142.687639:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789050142.687671:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789050142.687729:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789050142.687766:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789050142.687798:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789050142.687842:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789050142.687877:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789050142.687909:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789050142.687966:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789050142.688002:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789050142.692128:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789050142.692222:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789050142.692298:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789050142.692336:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789050142.692400:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789050142.692577:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789050142.692671:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789050142.692679:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789050142.692791:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050142.692852:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.695162:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050142.695350:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148864 00000100:00100000:3.0:1789050142.695359:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148864 00000100:00100000:3.0:1789050142.695410:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050142.695419:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704148864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050142.695672:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704148864:12345-0@lo:501:mount.lustre.0 Request processed in 253us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.695883:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050142.695940:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050142.695989:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050142.696275:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.696448:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.699933:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704148992 00000100:00100000:0.0:1789050142.699946:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704148992 00000100:00100000:0.0:1789050142.700005:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789050142.700014:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704148992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050142.700276:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704148992:12345-0@lo:503:mount.lustre.0 Request processed in 263us (4243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.700289:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789050142.700291:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704148992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050142.700931:0:15802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050142.701016:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050142.701061:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.701099:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.704184:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149120 00000100:00100000:0.0:1789050142.704197:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149120 00000100:00100000:0.0:1789050142.704257:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789050142.704264:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704149120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050142.704532:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704149120:12345-0@lo:502:mount.lustre.0 Request processed in 267us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.704540:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789050142.704771:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050142.705014:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789050142.705069:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789050142.705101:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789050142.705158:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789050142.705216:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789050142.705268:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789050142.705306:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789050142.705341:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789050142.705391:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789050142.705430:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789050142.705814:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789050142.705894:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789050142.705935:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789050142.705985:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789050142.706036:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789050142.706072:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789050142.706104:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789050142.706165:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789050142.706220:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789050142.706257:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789050142.706302:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789050142.706338:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789050142.706371:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789050142.706415:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789050142.707542:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789050142.707598:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789050142.707657:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789050142.707882:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789050142.707927:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789050142.708031:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789050142.708071:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789050142.708105:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789050142.708149:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789050142.708216:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789050142.708255:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789050142.708303:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789050142.708340:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789050142.708374:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789050142.708422:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789050142.709061:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789050142.709117:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050142.709231:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.709282:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050142.709578:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149248 00000100:00100000:2.0:1789050142.709586:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149248 00000100:00100000:2.0:1789050142.709626:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050142.709635:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704149248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050142.709857:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704149248:12345-0@lo:502:mount.lustre.0 Request processed in 222us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050142.709864:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789050142.710136:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050142.710263:0:15802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789050142.710275:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789050142.712087:0:15812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789050142.712103:0:15812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95073f3d8000) 00000020:00000080:1.0:1789050142.712124:0:15812:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789050142.712236:0:15812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950604d74800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789050142.712241:0:15812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950604d74800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789050142.712243:0:15812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604d74800 3 00010000:00080000:1.0:1789050142.712272:0:15812:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950702eb1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.101@tcp at head 00010000:00010000:1.0:1789050142.714615:0:15812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789050142.714822:0:15812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789050142.714856:0:15812:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789050142.714870:0:15812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9df728c939b79c3a 00000100:00080000:1.0:1789050142.714879:0:15812:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789050142.714889:0:15812:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950702eb1800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:1.0:1789050142.714923:0:15812:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950606ee7800 x1875954704149376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789050142.714944:0:15812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789050142.715979:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050142.715986:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050142.715989:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050142.715992:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789050142.716103:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704149632:0@lo:400:kworker.0 00000100:00100000:3.0:1789050142.716172:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.716218:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050142.716224:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704149504:0@lo:400:kworker.0 00000100:00100000:3.0:1789050142.716247:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.716273:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149632 00000100:00100000:3.0:1789050142.716279:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149632 00000100:00100000:3.0:1789050142.716319:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149504 00000100:00100000:3.0:1789050142.716322:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149504 00000100:00100000:3.0:1789050142.716344:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050142.716351:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704149632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050142.716394:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704149632:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.716401:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050142.716414:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789050142.716420:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050142.716446:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704149504:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.716457:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789050142.716477:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789050142.716502:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c219500 x1875954704149504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050142.716514:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704149504:0@lo:400:kworker.0 00010000:00080000:3.0:1789050142.716525:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c21b100 x1875954704149632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050142.716533:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704149632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050142.716620:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704149376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789050142.716650:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.716670:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149376 00000100:00100000:3.0:1789050142.716674:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149376 00000100:00100000:3.0:1789050142.716691:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050142.717544:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704149376:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789050142.717566:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:3.0:1789050142.717606:0:14403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9df728c939b79c41 00000004:00100000:3.0:1789050142.717620:0:14403:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789050142.717649:0:14403:0:(import.c:65:import_set_state_nolock()) ffff950604d77000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050142.718418:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875954704149376:12345-0@lo:38:llog_process_th.0 Request processed in 874us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.718427:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789050142.718482:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950606ee7800 x1875954704149376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050142.718493:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789050142.718501:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789050142.718508:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789050142.718519:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789050142.718522:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789050142.718529:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704149376:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789050142.719933:0:15812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789050142.720029:0:15802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789050142.720051:0:15802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789050142.720070:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050142.720082:0:15802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789050142.720122:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789050142.720125:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.720126:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.720132:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.720133:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.720134:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.720135:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.720146:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.720148:0:15802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050142.720151:0:15802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789050142.720154:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789050142.720155:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.720155:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.720156:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.720157:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.720158:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.720159:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.720160:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.720161:0:15802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789050142.720821:0:15802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789050142.720841:0:15802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789050142.720901:0:15802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050142.720934:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149760 00000100:00100000:2.0:1789050142.720941:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149760 00000100:00100000:2.0:1789050142.720988:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789050142.720997:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:15802:x1875954704149760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789050142.721019:0:14395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789050142.721033:0:14395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789050142.721849:0:15802:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525840 going to sleep for 11 seconds 20000000:01000000:0.0:1789050142.756417:0:14395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789050142.756444:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789050142.756975:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789050142.756980:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789050142.756999:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.757017:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79bdf expref: 19 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.757025:0:14417:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.757066:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 19 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.757079:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 19 pid: 14394 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050142.757091:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704149888:0@lo:104: 00000100:00100000:3.0:1789050142.757159:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050142.757283:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050142.757552:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704149888 00000100:00100000:0.0:1789050142.757560:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704149888 00000100:00100000:0.0:1789050142.757605:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050142.757614:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704149888:12345-0@lo:104: 00010000:00010000:0.0:1789050142.757625:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050142.757674:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050142.757680:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:14417:x1875954704149888:12345-0@lo:104: Request processed in 68us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050142.757686:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789050142.758518:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050142.758527:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.758536:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789050142.758540:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.758565:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050142.758572:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050142.758578:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789050142.758606:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.758612:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789050142.758639:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.758646:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79be6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.758661:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050142.760688:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704150016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050142.760756:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050142.760844:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150016 00000100:00100000:1.0:1789050142.760851:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150016 00010000:00010000:1.0:1789050142.760881:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 20 pid: 14394 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050142.760911:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050142.760920:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+20:3282:x1875954704150016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050142.760953:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050142.760958:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 20 pid: 14394 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.760971:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 20 pid: 14394 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.760989:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.760997:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789050142.761009:0:14388:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004029183s 00010000:00010000:1.0:1789050142.761013:0:14388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761019:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761026:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761032:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761037:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050142.761041:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761048:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761064:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050142.761073:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050142.761112:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+20:3282:x1875954704150016:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050142.761121:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050142.761166:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704150016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050142.761425:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050142.761431:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050142.761856:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331e00/0x9df728c939b79be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79bdf expref: 19 pid: 14394 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050142.761869:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875954704149888:0@lo:104: 00010000:00010000:3.0:1789050142.761885:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.761894:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.761913:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050142.761920:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06c00/0x9df728c939b79c48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050142.770990:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:15802:x1875954704149760:12345-0@lo:253:mount.lustre.0 Request processed in 49986us (50080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050142.771004:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789050142.771078:0:15802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:15802:1875954704149760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789050142.771093:0:15802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789050142.771097:0:15802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789050142.771098:0:15802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789050142.771099:0:15802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789050142.771101:0:15802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789050142.771102:0:15802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789050142.771103:0:15802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789050142.771104:0:15802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789050142.771115:0:15802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789050142.771117:0:15802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789050142.771150:0:15802:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789050142.782785:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050142.783056:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789050142.783551:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050142.783816:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789050142.784028:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050142.784340:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789050142.785616:0:15802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789050142.860565:0:15802:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789050142.860573:0:15802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789050142.860602:0:15802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789050142.860654:0:15802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789050142.860668:0:15802:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789050142.860705:0:15802:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789050143.632330:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050143.755401:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050127/real 1789050127] req@ffff95073c576300 x1875954704142976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.755432:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c576300 x1875954704142976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.755442:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050127/real 1789050127] req@ffff95073c577b80 x1875954704143104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.755452:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c577b80 x1875954704143104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050143.755480:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050143.755499:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050143.755504:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704142976:0@lo:8:kworker.0 00000100:00080000:0.0:1789050143.755510:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050143.755515:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050143.755518:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704143104:0@lo:8:kworker.0 00000100:00080000:3.0:1789050143.755671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050143.755676:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789050143.755679:0:36:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050143.755684:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1789050143.755689:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789050143.755698:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950720630000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050143.755716:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c218380 x1875954704150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050143.755884:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704150144:0@lo:400:kworker.0 00000100:00100000:1.0:1789050143.755943:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050143.756189:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150144 00000100:00100000:0.0:1789050143.756197:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150144 00000100:00100000:0.0:1789050143.756275:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050143.756284:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:3283:x1875954704150144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050143.756336:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:3283:x1875954704150144:12345-0@lo:400:kworker.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050143.756343:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050143.756383:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704150144:0@lo:400:kworker.0 00000100:00080000:3.0:1789050143.757865:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050143.757882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789050143.757885:0:36:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050143.757907:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1789050143.757911:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789050143.757921:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95072f422000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050143.757949:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c218700 x1875954704150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050143.758029:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704150528:0@lo:400:kworker.0 00000100:00100000:2.0:1789050143.758072:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704150656:0@lo:400:kworker.0 00000100:00100000:3.0:1789050143.758081:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.758112:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.758160:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704150784:0@lo:400:kworker.0 00000100:00100000:2.0:1789050143.758183:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.758327:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150528 00000100:00100000:2.0:1789050143.758332:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150528 00000100:00100000:2.0:1789050143.758360:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150656 00000100:00100000:2.0:1789050143.758362:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150656 00000100:00100000:2.0:1789050143.758374:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150784 00000100:00100000:2.0:1789050143.758376:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150784 00000100:00100000:2.0:1789050143.758398:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050143.758407:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704150528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050143.758457:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704150528:12345-0@lo:400:kworker.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050143.758463:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789050143.758477:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050143.758482:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704150656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050143.758512:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704150656:12345-0@lo:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050143.758518:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050143.759294:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050143.759304:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704150784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050143.759346:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704150784:12345-0@lo:400:kworker.0 Request processed in 45us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050143.759352:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789050143.759394:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c21a680 x1875954704150784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050143.759408:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704150784:0@lo:400:kworker.0 00010000:00080000:2.0:1789050143.759443:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c21ad80 x1875954704150656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050143.759453:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704150656:0@lo:400:kworker.0 00000100:00080000:2.0:1789050143.759480:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789050143.759506:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c21b800 x1875954704150528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050143.759515:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704150528:0@lo:400:kworker.0 00000100:00100000:0.0:1789050143.760373:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704150272:0@lo:8:kworker.0 00000100:00100000:0.0:1789050143.760426:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050143.760611:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704150400:0@lo:8:kworker.0 00000100:00100000:0.0:1789050143.760639:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050143.760790:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150272 00000100:00100000:3.0:1789050143.760797:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150272 00000100:00100000:3.0:1789050143.760826:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150400 00000100:00100000:3.0:1789050143.760829:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150400 00000100:00100000:3.0:1789050143.760841:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050143.760847:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875954704150272:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050143.760871:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:3.0:1789050143.760901:0:15087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b79c4f 00002000:00100000:3.0:1789050143.760914:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff950604d70000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789050143.760918:0:15087:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789050143.760920:0:15087:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789050143.762240:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789050143.762267:0:15087:0:(import.c:65:import_set_state_nolock()) ffff950604d77800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050143.762328:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704150272:12345-0@lo:8:kworker.0 Request processed in 1480us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050143.762337:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050143.762358:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050143.762363:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875954704150400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050143.762381:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:3.0:1789050143.762414:0:15087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b79c56 00002000:00100000:3.0:1789050143.762424:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff950604d71000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789050143.762428:0:15087:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789050143.762430:0:15087:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789050143.762888:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789050143.762903:0:15087:0:(import.c:65:import_set_state_nolock()) ffff950604d71800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050143.762938:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704150400:12345-0@lo:8:kworker.0 Request processed in 573us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050143.762957:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789050143.765242:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c218380 x1875954704150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.765256:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050143.765265:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789050143.765273:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789050143.765278:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789050143.765281:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789050143.765299:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789050143.765305:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704150272:0@lo:8:kworker.0 00010000:00080000:0.0:1789050143.765322:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c218700 x1875954704150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.765330:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050143.765333:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789050143.765337:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789050143.765340:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789050143.765342:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789050143.765350:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789050143.765353:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704150400:0@lo:8:kworker.0 00000004:00080000:3.0:1789050143.765666:0:14424:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789050143.765685:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875954704151040:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789050143.765691:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704150912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050143.766181:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050143.766514:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704150912 00000100:00100000:1.0:1789050143.766522:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704150912 00000100:00100000:1.0:1789050143.766588:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050143.766597:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704150912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050143.766628:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050143.766669:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875954704150912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050143.766676:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789050143.766903:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789050143.766931:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c21b480 x1875954704150912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050143.766956:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704150912:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789050143.767851:0:14426:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789050143.767870:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875954704151296:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789050143.767911:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.767933:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070910f540 going to sleep for 11 seconds 00000004:00080000:2.0:1789050143.767949:0:14423:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789050143.768267:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050143.768302:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050143.768340:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151168 00000100:00100000:1.0:1789050143.768345:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151168 00000100:00100000:1.0:1789050143.768387:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050143.768397:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704151168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050143.768422:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050143.768464:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875954704151168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050143.768484:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789050143.768567:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789050143.768588:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c57b100 x1875954704151168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050143.768604:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704151168:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789050143.769030:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379756829830ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789050143.769152:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151296 00000100:00100000:2.0:1789050143.769157:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151296 00000100:00100000:2.0:1789050143.769190:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050143.769197:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875954704151296:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789050143.769329:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050143.769348:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1789050143.769360:0:14425:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789050143.772898:0:14425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379760696585ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789050143.772954:0:15087:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789050143.772962:0:15087:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789050143.773061:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151040 00000100:00100000:3.0:1789050143.773069:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151040 00000100:00100000:3.0:1789050143.773178:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050143.773188:0:15848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14424:x1875954704151040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789050143.779038:0:15086:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789050143.779048:0:15086:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789050143.779052:0:15086:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00080000:3.0:1789050143.780653:0:15848:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789050143.780661:0:15848:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789050143.780665:0:15848:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1789050143.785242:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.785253:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.785275:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.785280:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.785286:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.785303:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.785314:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.785327:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.785571:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.787348:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.787359:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.787372:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.787376:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.787386:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.787423:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.787431:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f8c6f62/0x9df728c939b79c5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.787453:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.787454:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.787456:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.788434:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.788443:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.788456:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.788461:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.788467:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.788481:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.788490:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.788499:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789193:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050143.789649:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.789656:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789668:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.789672:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.789677:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789688:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789697:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789782:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789800:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.789811:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050143.789817:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789824:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.789836:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789846:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.789849:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.789866:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789874:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b79c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.789890:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.789892:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.789894:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790009:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790016:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.790040:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.790044:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.790054:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.790068:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.790076:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e7bba58/0x9df728c939b79c6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.790090:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790091:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790093:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790097:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.790098:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.792019:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.792030:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792056:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.792061:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.792067:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792079:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792088:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792101:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792121:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050143.792566:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.792572:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.792689:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.792696:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792717:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.792721:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.792725:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792739:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792748:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792756:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792771:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050143.792784:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050143.792789:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792795:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.792799:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.792801:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.792805:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792808:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792822:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792827:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792838:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792850:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792855:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792864:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79c72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.792866:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050143.792888:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050143.792892:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792899:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050143.792903:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792910:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792921:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792928:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79c80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792944:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050143.792947:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792960:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050143.792964:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792972:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792986:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.792993:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793008:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.793010:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.793011:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.793560:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.793567:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793578:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.793581:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.793586:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793596:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793612:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793620:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.793631:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050143.793635:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789050143.793640:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.793645:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.793659:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.793664:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.793674:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.793690:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.793699:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b79c87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.793733:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.793735:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.793737:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.793745:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.793884:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.793891:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793906:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.793910:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.793915:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793925:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793934:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793942:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793960:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.793969:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.793974:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793982:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.793986:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.793994:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.794016:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.794024:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b79c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.794039:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.794257:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.794264:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.794272:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.794275:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.794279:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.794288:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.794297:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.794304:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.794333:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050143.794443:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050143.794450:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.794458:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.794495:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.794516:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.794528:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.794536:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065951603/0x9df728c939b79c95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.794542:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.794544:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.794755:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.794760:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050143.795254:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.795261:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795270:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.795273:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.795278:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795290:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795298:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795306:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795332:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050143.795965:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.795971:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795982:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.795985:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.795989:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.795999:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796008:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796015:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796029:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.796038:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050143.796115:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796123:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.796142:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796152:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796166:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796174:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b79ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796189:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.796193:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796222:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.796226:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796234:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796245:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796253:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ed382a/0x9df728c939b79caa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.796272:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.796275:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.796277:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.797386:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.797394:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797407:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.797411:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.797417:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797428:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797437:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797446:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797462:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.797474:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.797479:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797496:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.797501:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.797510:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.797792:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.797796:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.797802:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.797815:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.797825:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.797833:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.797875:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.798306:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798317:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b79cb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798337:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.798341:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798349:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.798354:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798362:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798377:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.798392:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.798392:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b13d7d8/0x9df728c939b79c9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798402:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798412:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.798413:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.798415:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.798417:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.798425:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.798430:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798441:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798449:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798457:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798479:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.798484:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.798489:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798497:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.798501:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.798510:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.798817:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.798823:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798832:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.798836:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.798840:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798849:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798859:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798871:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.798880:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.799363:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799374:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20c7f7d/0x9df728c939b79cb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799393:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.799396:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799410:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.799415:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799424:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799437:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799443:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a3e099d/0x9df728c939b79cbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799458:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.799460:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.799462:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.799476:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.799483:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799492:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.799495:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.799500:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799510:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799519:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799526:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799547:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.799552:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.799557:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799565:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.799569:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799578:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799662:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799670:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b79cc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.799688:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.799690:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.799693:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.799700:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.799931:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.799937:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799951:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.799954:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.799958:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799968:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799978:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.799986:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.800004:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.800164:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.800170:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800177:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.800181:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800191:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800222:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800232:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026e2eda0/0x9df728c939b79ccd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800256:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.800259:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.800261:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.800491:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.800497:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800506:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.800510:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.800514:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.800516:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.800523:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800857:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800869:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800877:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.800894:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050143.801111:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050143.801119:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.801128:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.801143:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.801153:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.801706:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.801780:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b79cd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.801817:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.801819:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.801821:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.803003:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.803012:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803037:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.803106:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.803114:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803127:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803147:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803155:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803179:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.803195:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.803218:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803225:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.803229:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803237:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803262:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803269:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b79ce2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803285:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.803286:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.803288:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.803294:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.803779:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.803785:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.803792:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803806:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803828:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803837:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803870:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050143.803881:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050143.803886:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803895:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050143.803899:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803907:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803920:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803929:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3f15771/0x9df728c939b79cdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050143.803945:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.803948:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.803952:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.803956:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.803960:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.803966:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.803970:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.803974:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803985:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.803994:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804002:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804023:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.804033:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.804036:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804111:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.804115:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804125:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804146:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804154:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b79ce9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.804168:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.804171:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.804174:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.804663:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.804670:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.804680:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.804684:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.804688:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.804699:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.805297:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.805310:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.805329:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050143.805334:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.805341:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805351:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.805360:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.805365:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805376:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805385:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805392:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805409:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.805421:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050143.805426:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805434:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.805439:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805448:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805462:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805481:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d36205f1/0x9df728c939b79cf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805500:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.805504:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805510:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.805514:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805578:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805648:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805656:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79cf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.805676:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.805679:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.805681:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.805688:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.806401:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.806409:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.806421:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.806424:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1789050143.806426:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.806430:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806441:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.806450:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806451:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.806460:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.806471:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806471:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.806495:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806499:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806511:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.806640:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.807124:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.807129:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.807145:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807154:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ee00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.807158:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807167:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807193:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807223:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79cfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807246:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.807248:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.807251:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.807265:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.807273:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.807278:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807285:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.807289:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807297:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807310:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807319:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79d05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.807351:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.807354:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.807357:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.808032:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.808039:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808116:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.808120:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.808126:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808147:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808155:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808163:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808178:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.808187:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.808192:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808229:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.808233:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808242:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808254:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808262:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79d0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.808276:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.808278:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.808279:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.808920:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.808929:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.808940:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.808957:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.808962:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.808972:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.808981:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.809000:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.809019:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050143.809120:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.809128:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809146:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.809150:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.809155:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809165:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809180:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809188:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809234:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.809241:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809248:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.809251:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809261:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809274:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809282:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79d1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809297:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.809299:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.809306:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.809318:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.809327:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.809332:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809339:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.809343:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809351:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809364:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809371:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.809390:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.809392:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.809394:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.810223:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.810231:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810242:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.810246:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.810257:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810268:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810277:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810285:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810298:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.810307:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.810312:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810320:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.810323:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810331:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810342:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810359:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365d9940/0x9df728c939b79d21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.810373:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.810374:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.810376:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.810881:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.810889:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.810900:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.810904:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.810909:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.810920:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.810928:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.810936:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.810956:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.810988:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.810995:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.811003:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ea00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.811007:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.811016:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.811030:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.811037:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e222fb6/0x9df728c939b79d28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.811118:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.811121:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.811123:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.811566:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.811573:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.811588:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.811591:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.811595:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.811605:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.811614:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.811621:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.812387:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.812412:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.812420:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812428:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.812433:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812443:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812458:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812466:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca9b08f/0x9df728c939b79d2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812483:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.812759:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.812762:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.812830:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.812837:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812847:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.812851:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.812855:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812879:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812887:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812895:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812908:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.812915:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.812920:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812927:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.812930:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812938:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812948:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812955:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8878b7c/0x9df728c939b79d36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.812974:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.812976:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.812977:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.813410:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.813418:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.813428:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.813432:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.813436:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.813447:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.813466:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.813475:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.813495:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.813654:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.813661:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.813669:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fe00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.813673:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.813683:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.813695:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814423:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5e3a32/0x9df728c939b79d3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814445:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.814447:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.814450:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.814544:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.814551:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.814562:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.814565:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.814570:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.814581:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.814589:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.814597:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050143.814838:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.814844:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814862:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.814866:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.814871:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814881:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814890:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.814898:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.814996:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.815002:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.815013:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050143.815019:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815026:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.815031:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815097:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815125:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815142:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8547706/0x9df728c939b79d44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815160:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.815164:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815171:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.815175:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815183:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815196:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815223:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041de65c6/0x9df728c939b79d4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815238:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.815240:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.815247:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.815516:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.815522:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.815531:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.815535:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.815539:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.815548:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.815556:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.815563:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.815581:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.815943:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.815948:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815955:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.815959:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815967:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815979:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.815987:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad5ce27/0x9df728c939b79d52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816002:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.816003:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.816005:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.816299:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.816305:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816314:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.816317:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.816322:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816336:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816345:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816352:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816365:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.816373:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.816376:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816383:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.816386:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816394:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816404:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816412:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1e721a/0x9df728c939b79d59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.816429:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.816430:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.816432:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.817614:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.817622:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817634:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.817637:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.817642:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817653:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817661:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817670:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817688:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.817814:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.817821:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817840:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.817844:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817853:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817867:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817874:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000271c11ed/0x9df728c939b79d60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.817891:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.817892:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.817894:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.818395:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.818403:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818415:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=379s v=(0 0) 00002000:00010000:2.0:1789050143.818416:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.818423:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818425:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.818434:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818437:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.818445:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.818452:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818453:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818475:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818475:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818485:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818498:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818507:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.818512:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.818639:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.818645:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818654:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.818658:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818667:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818680:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818688:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdd03ea/0x9df728c939b79d67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818774:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.818777:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.818785:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.818797:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.818806:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.818811:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818819:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.818822:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818830:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818843:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818851:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90b6187/0x9df728c939b79d6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.818867:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.818869:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.818872:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.819036:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.819043:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819051:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.819055:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.819059:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819069:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819076:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819089:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819107:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.819112:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.819118:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819127:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fa00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.819140:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819156:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819168:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819176:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb6a16e/0x9df728c939b79d75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819193:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.819197:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.819216:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.819620:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.819627:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819636:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.819639:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.819644:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819654:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819663:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819671:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.819691:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.819773:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.819893:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819902:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fc00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.819906:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819915:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819927:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819946:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bee755e/0x9df728c939b79d7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.819962:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.819964:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.819966:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.819975:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.820028:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.820035:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820111:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.820115:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.820120:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820141:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820150:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820157:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820174:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.820186:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.820197:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820220:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.820223:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820231:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820242:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820249:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e26665/0x9df728c939b79d83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820265:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.820268:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.820270:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.820600:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.820607:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.820622:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.820625:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.820630:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.820639:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.820648:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.820655:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050143.820911:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.820917:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820925:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.820928:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.820932:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820951:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820959:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.820966:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.822183:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.822227:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050143.822241:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050143.822248:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822259:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.822263:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822273:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822289:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822296:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2328670/0x9df728c939b79d8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822324:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.822328:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822334:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.822338:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822346:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822356:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822364:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b79d91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822380:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.822383:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.822384:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.822972:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.822978:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.822990:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.822994:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.823004:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.823014:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.823023:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.823428:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.823435:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.823445:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.823449:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.823453:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.823463:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.823482:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.823490:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.823512:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.824933:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.824962:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.824970:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.824979:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ec00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.824984:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.824993:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825012:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825020:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e7d337d/0x9df728c939b79d9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825048:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825050:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825052:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.825057:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.825065:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825068:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050143.825080:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.825081:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050143.825088:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.825089:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.825096:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825099:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.825105:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.825113:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825115:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.825144:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825150:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.825156:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825162:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b79d98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825180:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825183:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.825187:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.825188:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789050143.825441:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.825445:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825454:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825467:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825474:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e7f8a0/0x9df728c939b79da6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825488:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825489:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825491:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.825496:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050143.825691:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.825698:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050143.825966:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.825972:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.825982:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.825985:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.825990:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826009:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826018:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826025:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826039:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.826047:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.826052:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826059:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.826062:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826069:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826080:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826087:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b79db4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826106:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.826107:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.826109:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.826508:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.826514:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826523:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.826526:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.826531:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826539:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826548:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826555:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826569:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.826577:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.826580:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826596:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.826600:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826608:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826619:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826626:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b79dbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826638:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.826639:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.826640:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050143.826960:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050143.826966:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826974:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789050143.826977:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050143.826981:0:15086:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.826990:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827005:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827012:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827024:0:15086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050143.827031:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.827035:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827042:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.827045:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827053:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827063:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827070:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b79dc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.827082:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.827088:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050143.828090:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.828095:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.828101:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828115:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828124:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828143:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828162:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050143.828664:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.828671:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828679:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.828687:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.828691:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828702:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828709:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828717:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.828724:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050143.830195:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1789050143.832503:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.832516:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.832532:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.832537:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.832543:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.832556:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.832566:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.832581:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.832593:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050143.832902:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832913:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.832919:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832930:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832949:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832958:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363624e6/0x9df728c939b79dad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832978:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050143.832982:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.832988:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.832998:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.833007:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.833019:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.833026:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6484497/0x9df728c939b79dc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.833040:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050143.833044:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.833051:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050143.833055:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050143.833175:0:15848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050143.833182:0:15848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.833191:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789050143.833195:0:15848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050143.833234:0:15848:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.833246:0:15848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.833254:0:15848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.833261:0:15848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050143.833269:0:15848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789050143.833421:0:15848:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1789050143.833500:0:15848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14424:x1875954704151040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 60312us (64169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050143.833514:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050143.833561:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875954704151040:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789050143.833575:0:14424:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789050143.833613:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875954704151424:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789050143.833642:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050143.833669:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050143.833683:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151424 00000100:00100000:3.0:1789050143.833689:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151424 00000100:00100000:3.0:1789050143.833722:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050143.833730:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1875954704151424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789050143.833762:0:15087:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1789050143.834512:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050143.834574:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.834588:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05ee00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050143.834654:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.834673:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.834674:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.834701:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.834710:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001083bec0/0x9df728c939b79dd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050143.834735:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.834739:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050143.834741:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.834766:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.834820:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d4608a/0x9df728c939b79dd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050143.834840:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.834842:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.834844:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050143.834851:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789050143.835341:0:15086:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789050143.835403:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875954704151296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66204us (67489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050143.835411:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050143.835451:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875954704151296:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789050143.835465:0:14426:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789050143.835501:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875954704151552:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789050143.835646:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050143.835669:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073ca6b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050143.835682:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151552 00000100:00100000:2.0:1789050143.835687:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151552 00000100:00100000:2.0:1789050143.835840:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050143.835850:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875954704151552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789050143.835882:0:15086:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1789050143.843980:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789050143.844514:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14426:x1875954704151552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8663us (8864us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789050143.844611:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050143.844668:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875954704151552:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789050143.844683:0:14426:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1789050143.861573:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789050143.863252:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14424:x1875954704151424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29517us (29604us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789050143.863263:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050143.864938:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875954704151424:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789050143.864955:0:14424:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:0.0:1789050144.011604:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789050144.011612:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff950605aa8800 from 8 10000000:01000000:0.0:1789050144.011617:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050144.011661:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050144.011672:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050144.011685:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050144.011830:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704151680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050144.011894:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050144.011943:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073cfec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050144.011997:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151680 00000100:00100000:3.0:1789050144.012005:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151680 00000100:00100000:3.0:1789050144.012056:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789050144.012065:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:14398:x1875954704151680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050144.012077:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050144.012090:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05ee00/0x9df728c939b79de5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79dde expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050144.012111:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05ee00/0x9df728c939b79de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79dde expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050144.012122:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05ee00/0x9df728c939b79de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79dde expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050144.012154:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ee00, rc 0) 00000100:00100000:3.0:1789050144.012230:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704151680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050144.012237:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789050144.012322:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704151680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050144.012337:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050144.012346:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050144.012391:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704151808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050144.012422:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050144.012453:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073ca6b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789050144.012502:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151808 00000100:00100000:0.0:1789050144.012506:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151808 00000100:00100000:0.0:1789050144.012538:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789050144.012545:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704151808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789050144.012558:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789050144.012573:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789050144.012579:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789050144.012648:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704151808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050144.012654:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789050144.012833:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704151808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789050144.012882:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789050144.012893:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050144.012901:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050144.492341:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789050144.492565:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789050144.651354:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050145.677152:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050146.700886:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050147.726909:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789050148.113532:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789050148.113591:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789050148.748391:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050149.003515:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704152320:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.003581:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.003631:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789050149.003637:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704151936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050149.003663:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.003686:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704152448:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.003709:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.003735:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704152064:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.003761:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.003923:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704152576:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.003948:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.003968:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789050149.003974:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704152192:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.004124:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.004153:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.004174:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050149.004448:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152320 00000100:00100000:3.0:1789050149.004456:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152320 00000100:00100000:3.0:1789050149.004767:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152192 00000100:00100000:3.0:1789050149.004771:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152192 00000100:00100000:3.0:1789050149.004950:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050149.004959:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704152320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.005086:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704152320:12345-0@lo:400:kworker.0 Request processed in 56us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.005094:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050149.005120:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050149.005127:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704152192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.005162:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704152192:12345-0@lo:400:kworker.0 Request processed in 36us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.005167:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050149.005191:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704151936 00000100:00100000:3.0:1789050149.005195:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704151936 00000100:00100000:3.0:1789050149.005237:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050149.005243:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704151936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050149.005266:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050149.005310:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704151936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.005316:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050149.005335:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152448 00000100:00100000:3.0:1789050149.005338:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152448 00000100:00100000:3.0:1789050149.005356:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152576 00000100:00100000:3.0:1789050149.005358:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152576 00000100:00100000:3.0:1789050149.005371:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152704 00000100:00100000:3.0:1789050149.005373:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152704 00000100:00100000:3.0:1789050149.005385:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050149.005391:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704152448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.005421:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704152448:12345-0@lo:400:kworker.0 Request processed in 29us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.005433:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050149.005446:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050149.005452:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704152576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.005481:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704152576:12345-0@lo:400:kworker.0 Request processed in 30us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.005486:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050149.006231:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050149.006243:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704152704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.006284:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704152704:12345-0@lo:400:kworker.0 Request processed in 46us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.006290:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050149.006316:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152064 00000100:00100000:3.0:1789050149.006320:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152064 00000100:00100000:3.0:1789050149.006354:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789050149.006360:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704152064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.006390:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704152064:12345-0@lo:400:kworker.0 Request processed in 30us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050149.006395:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789050149.006427:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050149.006433:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050149.006435:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050149.006480:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789050149.006513:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704152192:0@lo:400:kworker.0 00010000:00080000:3.0:1789050149.006527:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c25aa00 x1875954704152704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050149.006559:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704152704:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.006571:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704152064:0@lo:400:kworker.0 00010000:00080000:3.0:1789050149.006582:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c21b480 x1875954704152576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050149.006591:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704152576:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.006627:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704151936:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789050149.006638:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c219c00 x1875954704152448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050149.006645:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704152448:0@lo:400:kworker.0 00000100:00100000:3.0:1789050149.006654:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789050149.006663:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704152320:0@lo:400:kworker.0 00000100:00100000:1.0:1789050149.014118:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050149.016044:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704152832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050149.016120:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050149.016169:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152832 00000100:00100000:1.0:1789050149.016177:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152832 00000100:00100000:1.0:1789050149.016232:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050149.016241:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704152832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050149.016274:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050149.016314:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704152832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050149.016321:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050149.016367:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704152832:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789050149.134088:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789050149.668196:0:16159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789050149.773983:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050150.801614:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050151.827650:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050152.642608:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.642749:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691577984 00000100:00100000:2.0:1789050152.642761:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691577984 00000100:00100000:2.0:1789050152.642815:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:2.0:1789050152.642825:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875954691577984:12345-192.168.206.1@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789050152.642859:0:14396:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 656da5f8-c3d1-4665-81e8-e4fab3402cd9@192.168.206.1@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:2.0:1789050152.642896:0:14396:0:(genops.c:1384:class_connect()) connect: client 656da5f8-c3d1-4665-81e8-e4fab3402cd9, cookie 0x9df728c939b79dec 00000100:00080000:2.0:1789050152.643063:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9506046d2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050152.643172:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+5:2346:x1875954691577984:12345-192.168.206.1@tcp:250:mount.lustre.0 Request processed in 346us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.643180:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:2.0:1789050152.648501:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050152.648630:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578112 00000100:00100000:3.0:1789050152.648642:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578112 00000100:00100000:3.0:1789050152.648701:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:3.0:1789050152.648712:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+5:13722:x1875954691578112:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789050152.648732:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050152.648753:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05ec00/0x9df728c939b79df3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fba5 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050152.648786:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05ec00/0x9df728c939b79df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fba5 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050152.648830:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05ec00/0x9df728c939b79df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fba5 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050152.648841:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05ec00, rc 0) 00000100:00100000:3.0:1789050152.648950:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+6:13722:x1875954691578112:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 239us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050152.648957:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:1.0:1789050152.668097:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050152.668241:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578240 00000100:00100000:0.0:1789050152.668255:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578240 00000100:00100000:0.0:1789050152.668328:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:0.0:1789050152.668341:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+6:13722:x1875954691578240:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789050152.668783:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+6:13722:x1875954691578240:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 443us (708us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050152.668792:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:1.0:1789050152.682671:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.687540:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578368 00000100:00100000:2.0:1789050152.687563:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578368 00000100:00100000:2.0:1789050152.687639:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:2.0:1789050152.687651:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+6:13722:x1875954691578368:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050152.687689:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050152.687710:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51e00/0x9df728c939b79dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fbac expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.687743:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51e00/0x9df728c939b79dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbac expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.687756:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51e00/0x9df728c939b79dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbac expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.687765:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51e00, rc 0) 00000100:00100000:2.0:1789050152.687851:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+7:13722:x1875954691578368:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 202us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.687858:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:1.0:1789050152.717313:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050152.717693:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578496 00000100:00100000:3.0:1789050152.717706:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578496 00000100:00100000:3.0:1789050152.717771:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:3.0:1789050152.717781:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+7:13722:x1875954691578496:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789050152.718151:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13722:x1875954691578496:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 370us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050152.718159:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:2.0:1789050152.726533:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050152.727767:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578624 00000100:00100000:3.0:1789050152.727781:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578624 00000100:00100000:3.0:1789050152.727848:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:3.0:1789050152.727861:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13722:x1875954691578624:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789050152.728348:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13722:x1875954691578624:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 488us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050152.728358:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:2.0:1789050152.739949:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050152.741322:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578752 00000100:00100000:3.0:1789050152.741341:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578752 00000100:00100000:3.0:1789050152.742252:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:3.0:1789050152.742268:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13741:x1875954691578752:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050152.744025:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13741:x1875954691578752:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 1749us (4076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050152.744041:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:1.0:1789050152.819938:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.821232:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691578880 00000100:00100000:2.0:1789050152.821248:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691578880 00000100:00100000:2.0:1789050152.821317:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:2.0:1789050152.821329:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13741:x1875954691578880:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050152.821673:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13741:x1875954691578880:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 345us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.821681:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:3.0:1789050152.827752:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050152.830180:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579008 00000100:00100000:0.0:1789050152.830224:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579008 00000100:00100000:0.0:1789050152.830303:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 83 00000100:00100000:0.0:1789050152.830315:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:13722:x1875954691579008:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050152.830338:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050152.830361:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331400/0x9df728c939b79e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fbd6 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050152.830396:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331400/0x9df728c939b79e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbd6 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050152.830409:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331400/0x9df728c939b79e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbd6 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050152.830420:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331400, rc 0) 00000100:00100000:0.0:1789050152.830504:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+9:13722:x1875954691579008:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 190us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050152.830529:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 83 00010000:00010000:2.0:1789050152.844254:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050152.860816:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050152.861059:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579136 00000100:00100000:3.0:1789050152.861073:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579136 00000100:00100000:3.0:1789050152.861150:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:3.0:1789050152.861162:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+9:13722:x1875954691579136:12345-192.168.206.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789050152.861194:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789050152.861257:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789050152.861262:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789050152.861265:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789050152.861267:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789050152.875412:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+9:13722:x1875954691579136:12345-192.168.206.1@tcp:256:mount.lustre.0 Request processed in 14227us (14587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.875447:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:1.0:1789050152.878851:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.880580:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579264 00000100:00100000:2.0:1789050152.880598:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579264 00000100:00100000:2.0:1789050152.880679:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:2.0:1789050152.880692:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+9:13722:x1875954691579264:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050152.880713:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050152.880735:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fbdd expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.880772:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.880785:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050152.880796:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50400, rc 0) 00000100:00100000:2.0:1789050152.880877:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13722:x1875954691579264:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 187us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.880885:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:0.0:1789050152.884496:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.885447:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579392 00000100:00100000:2.0:1789050152.885462:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579392 00000100:00100000:2.0:1789050152.885540:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:2.0:1789050152.885552:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13722:x1875954691579392:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050152.885948:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13722:x1875954691579392:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 397us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050152.885958:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:3.0:1789050152.894284:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050152.894867:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579520 00000100:00100000:0.0:1789050152.894885:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579520 00000100:00100000:0.0:1789050152.894976:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:0.0:1789050152.894989:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13722:x1875954691579520:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050152.895519:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13722:x1875954691579520:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 531us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050152.895529:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:1.0:1789050152.903614:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.903789:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579648 00000100:00100000:2.0:1789050152.903803:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579648 00000100:00100000:2.0:1789050152.903882:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:2.0:1789050152.903894:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13746:x1875954691579648:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050152.905563:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13746:x1875954691579648:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 1658us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050152.905576:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:2.0:1789050152.923432:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050152.923605:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579776 00000100:00100000:0.0:1789050152.923618:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579776 00000100:00100000:0.0:1789050152.923689:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:0.0:1789050152.923702:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13746:x1875954691579776:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050152.924023:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13746:x1875954691579776:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 323us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050152.924031:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:3.0:1789050152.945842:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050152.948031:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691579904 00000100:00100000:2.0:1789050152.948052:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691579904 00000100:00100000:2.0:1789050152.948147:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789050152.948158:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875954691579904:12345-192.168.206.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789050152.948569:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 66ca7618-37f8-428a-932b-a194d1b4ace8@192.168.206.1@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:2.0:1789050152.948637:0:14403:0:(genops.c:1384:class_connect()) connect: client 66ca7618-37f8-428a-932b-a194d1b4ace8, cookie 0x9df728c939b79e0f 00000004:00100000:2.0:1789050152.948676:0:14403:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789050152.948683:0:14403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789050153.054366:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9506046d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050153.054478:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2346:x1875954691579904:12345-192.168.206.1@tcp:38:mount.lustre.0 Request processed in 106318us (108643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050153.054491:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:2.0:1789050153.065675:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050153.065780:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050153.066073:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580160 00000100:00100000:3.0:1789050153.066094:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580160 00000100:00100000:3.0:1789050153.066175:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580032 00000100:00100000:3.0:1789050153.066178:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580032 00000100:00100000:3.0:1789050153.066228:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050153.066241:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+7:13722:x1875954691580160:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789050153.066295:0:14401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050153.066397:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+7:13722:x1875954691580160:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 158us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050153.066412:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050153.066433:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050153.066440:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:0:x1875954691580032:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789050153.066480:0:14401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050153.066504:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:0:x1875954691580032:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 65us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050153.066510:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00080000:1.0:1789050153.067092:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050153.075444:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050153.077809:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580288 00000100:00100000:3.0:1789050153.077829:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580288 00000100:00100000:3.0:1789050153.077906:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050153.077919:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:13722:x1875954691580288:12345-192.168.206.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789050153.078039:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:13722:x1875954691580288:12345-192.168.206.1@tcp:40:mount.lustre.0 Request processed in 121us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050153.078047:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050153.088324:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050153.088368:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050153.088404:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050153.089289:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580672 00000100:00100000:2.0:1789050153.089302:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580672 00000100:00100000:2.0:1789050153.089372:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:2.0:1789050153.089383:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:13722:x1875954691580672:12345-192.168.206.1@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789050153.089596:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580416 00000100:00100000:1.0:1789050153.089601:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580416 00000100:00100000:1.0:1789050153.089630:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580544 00000100:00100000:1.0:1789050153.089633:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580544 00000100:00100000:1.0:1789050153.089663:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050153.089669:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875954691580416:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789050153.089697:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 66ca7618-37f8-428a-932b-a194d1b4ace8@192.168.206.1@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:1.0:1789050153.089733:0:15087:0:(genops.c:1384:class_connect()) connect: client 66ca7618-37f8-428a-932b-a194d1b4ace8, cookie 0x9df728c939b79e16 00002000:00100000:1.0:1789050153.089744:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 66ca7618-37f8-428a-932b-a194d1b4ace8/ffff95073cbc5000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789050153.089771:0:15087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789050153.090159:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789050153.090196:0:15087:0:(import.c:65:import_set_state_nolock()) ffff95073cbc1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050153.090318:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2346:x1875954691580416:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 647us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050153.090343:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050153.090366:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:1.0:1789050153.090371:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875954691580544:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789050153.090390:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 66ca7618-37f8-428a-932b-a194d1b4ace8@192.168.206.1@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:1.0:1789050153.090411:0:15087:0:(genops.c:1384:class_connect()) connect: client 66ca7618-37f8-428a-932b-a194d1b4ace8, cookie 0x9df728c939b79e1d 00002000:00100000:1.0:1789050153.090418:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 66ca7618-37f8-428a-932b-a194d1b4ace8/ffff95073cbc0000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789050153.090436:0:15087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789050153.091987:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789050153.092028:0:15087:0:(import.c:65:import_set_state_nolock()) ffff95073cbc4000 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1789050153.092122:0:14404:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2652us 00000100:00100000:1.0:1789050153.092526:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2346:x1875954691580544:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 2150us (4156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050153.092537:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000004:00200000:2.0:1789050153.144444:0:14404:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789050153.144830:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:13722:x1875954691580672:12345-192.168.206.1@tcp:33:mount.lustre.0 Request processed in 55440us (56416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050153.144850:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000001:00100000:0.0:1789050153.237615:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00000100:00100000:0.0:1789050153.405917:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050153.409391:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580800 00000100:00100000:2.0:1789050153.409413:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580800 00000100:00100000:2.0:1789050153.409514:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050153.409529:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:13767:x1875954691580800:12345-192.168.206.1@tcp:101:mkdir.0 00010000:00010000:2.0:1789050153.409569:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050153.409602:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc07 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.409886:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.409903:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.409919:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050153.409963:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050153.409967:0:14403:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050153.410011:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.410041:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc07 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.410304:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc07 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050153.410338:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050153.410342:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050153.410346:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050153.410444:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+7:13767:x1875954691580800:12345-192.168.206.1@tcp:101:mkdir.0 Request processed in 916us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050153.410454:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00010000:00010000:3.0:1789050153.869951:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050154.123480:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704152960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050154.123543:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050154.123667:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704152960 00000100:00100000:2.0:1789050154.123675:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704152960 00000100:00100000:2.0:1789050154.123728:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050154.123737:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704152960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050154.123757:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050154.123795:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704152960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050154.123801:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789050154.123860:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050154.123897:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704152960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050154.124021:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789050154.124029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704153088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050154.124085:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050154.124151:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153088 00000100:00100000:2.0:1789050154.124155:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153088 00000100:00100000:2.0:1789050154.124188:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050154.124194:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704153088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789050154.124225:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050154.124254:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704153088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050154.124260:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789050154.124434:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050154.124455:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704153088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050154.125809:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704153216:0@lo:400:kworker.0 00000100:00100000:1.0:1789050154.125870:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050154.125932:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153216 00000100:00100000:1.0:1789050154.125937:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153216 00000100:00100000:1.0:1789050154.125972:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789050154.125979:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704153216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050154.126016:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704153216:12345-0@lo:400:kworker.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050154.126022:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789050154.126055:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704153216:0@lo:400:kworker.0 00000100:00100000:2.0:1789050154.126159:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704153344:0@lo:400:kworker.0 00000100:00100000:2.0:1789050154.126190:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050154.126319:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153344 00000100:00100000:1.0:1789050154.126324:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153344 00000100:00100000:1.0:1789050154.126355:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789050154.126369:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050154.126456:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704153472:0@lo:400:kworker.0 00000100:00100000:3.0:1789050154.126484:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050154.126518:0:14403:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789050154.126525:0:14403:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789050154.126627:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153472 00000100:00100000:3.0:1789050154.126630:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153472 00000100:00100000:3.0:1789050154.126661:0:14403:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789050154.126667:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789050154.126673:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704153472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050154.126704:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704153472:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050154.126709:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789050154.126735:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704153472:0@lo:400:kworker.0 00000100:00080000:3.0:1789050154.126843:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050154.132927:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050154.132944:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704153600:0@lo:400:kworker.0 00000100:00100000:0.0:1789050154.133007:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050154.133050:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153600 00000100:00100000:0.0:1789050154.133068:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153600 00000100:00100000:0.0:1789050154.133132:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050154.133140:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704153600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050154.133190:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704153600:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050154.133224:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789050154.133247:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050154.133271:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704153600:0@lo:400:kworker.0 00000100:00100000:1.0:1789050154.135845:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704153344:12345-0@lo:400:kworker.0 Request processed in 9476us (9646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050154.135856:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050154.135938:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704153344:0@lo:400:kworker.0 00000001:00100000:3.0:1789050154.661732:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00010000:00010000:1.0:1789050154.891436:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050155.381435:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050155.382805:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691580928 00000100:00100000:3.0:1789050155.382818:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691580928 00000100:00100000:3.0:1789050155.382968:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789050155.382980:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+7:13819:x1875954691580928:12345-192.168.206.1@tcp:41:lfs.0 00000004:00000024:3.0:1789050155.383021:0:16279:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050155.383139:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+7:13819:x1875954691580928:12345-192.168.206.1@tcp:41:lfs.0 Request processed in 161us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050155.383146:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00080000:0.0:1789050155.383639:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050155.389311:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.389412:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581056 00000100:00100000:2.0:1789050155.389421:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581056 00000100:00100000:1.0:1789050155.389522:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050155.389533:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66ca7618-37f8-428a-932b-a194d1b4ace8+5:13819:x1875954691581056:12345-192.168.206.1@tcp:13:lfs.0 00002000:00000024:1.0:1789050155.389568:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050155.389660:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66ca7618-37f8-428a-932b-a194d1b4ace8+5:13819:x1875954691581056:12345-192.168.206.1@tcp:13:lfs.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.389667:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00080000:0.0:1789050155.390497:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050155.398037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.398171:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581184 00000100:00100000:1.0:1789050155.398181:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581184 00000100:00080000:0.0:1789050155.398298:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050155.398413:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:1.0:1789050155.398424:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66ca7618-37f8-428a-932b-a194d1b4ace8+5:13819:x1875954691581184:12345-192.168.206.1@tcp:13:lfs.0 00002000:00000024:1.0:1789050155.398475:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050155.398563:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66ca7618-37f8-428a-932b-a194d1b4ace8+5:13819:x1875954691581184:12345-192.168.206.1@tcp:13:lfs.0 Request processed in 141us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.398571:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789050155.572522:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.572808:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581312 00000100:00100000:1.0:1789050155.572820:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581312 00000100:00100000:1.0:1789050155.573016:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 91 00000100:00100000:1.0:1789050155.573027:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:13850:x1875954691581312:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789050155.573047:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050155.573080:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c531600/0x9df728c939b79e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc0e expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.573115:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c531600/0x9df728c939b79e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc0e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.573127:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c531600/0x9df728c939b79e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc0e expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.573138:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531600, rc 0) 00000100:00100000:1.0:1789050155.573313:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581312:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 287us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.573322:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 91 00000100:00100000:3.0:1789050155.581494:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.588048:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581440 00000100:00100000:1.0:1789050155.588081:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581440 00000100:00100000:1.0:1789050155.588302:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:1.0:1789050155.588317:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581440:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789050155.589447:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581440:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 1126us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.589519:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:0.0:1789050155.595483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.596130:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581568 00000100:00100000:2.0:1789050155.596144:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581568 00000100:00100000:2.0:1789050155.596230:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:2.0:1789050155.596243:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581568:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789050155.598654:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581568:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 2385us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.598672:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:2.0:1789050155.609911:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.611007:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581696 00000100:00100000:1.0:1789050155.611021:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581696 00000100:00100000:1.0:1789050155.611114:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:1.0:1789050155.611125:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13857:x1875954691581696:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050155.611737:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13857:x1875954691581696:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 610us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.611747:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:3.0:1789050155.637162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.637856:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581824 00000100:00100000:2.0:1789050155.637874:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581824 00000100:00100000:2.0:1789050155.637948:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:2.0:1789050155.637960:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13857:x1875954691581824:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050155.641745:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13857:x1875954691581824:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 2558us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.641869:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:2.0:1789050155.646457:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050155.648595:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691581952 00000100:00100000:0.0:1789050155.648613:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691581952 00000100:00100000:0.0:1789050155.648699:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:0.0:1789050155.648709:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13850:x1875954691581952:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050155.648728:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050155.648748:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331800/0x9df728c939b79e39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc38 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050155.648790:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331800/0x9df728c939b79e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc38 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050155.648801:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331800/0x9df728c939b79e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc38 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050155.648810:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331800, rc 0) 00000100:00100000:0.0:1789050155.648878:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13850:x1875954691581952:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 171us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050155.648899:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:3.0:1789050155.652877:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.653062:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582080 00000100:00100000:2.0:1789050155.653084:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582080 00000100:00100000:2.0:1789050155.653160:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:2.0:1789050155.653171:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13850:x1875954691582080:12345-192.168.206.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789050155.653247:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789050155.653289:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789050155.653293:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789050155.653297:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789050155.653300:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789050155.655020:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13850:x1875954691582080:12345-192.168.206.1@tcp:256:mount.lustre.0 Request processed in 1840us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.655035:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:3.0:1789050155.665871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.668990:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582208 00000100:00100000:1.0:1789050155.669008:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582208 00000100:00100000:1.0:1789050155.672333:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:1.0:1789050155.674259:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13850:x1875954691582208:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789050155.674285:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050155.674316:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc3f expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.674353:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.674367:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.674377:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531e00, rc 0) 00000100:00100000:1.0:1789050155.674531:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13850:x1875954691582208:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 2181us (8673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.674541:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:3.0:1789050155.678717:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.679152:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582336 00000100:00100000:2.0:1789050155.679164:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582336 00000100:00100000:2.0:1789050155.679258:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:2.0:1789050155.679269:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13850:x1875954691582336:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050155.679877:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13850:x1875954691582336:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 607us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.679887:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:3.0:1789050155.684039:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.684530:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582464 00000100:00100000:1.0:1789050155.684542:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582464 00000100:00100000:1.0:1789050155.684684:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:1.0:1789050155.684697:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13850:x1875954691582464:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789050155.685243:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13850:x1875954691582464:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 547us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.685252:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:3.0:1789050155.689123:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050155.689422:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582592 00000100:00100000:0.0:1789050155.689434:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582592 00000100:00100000:0.0:1789050155.689502:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:0.0:1789050155.689515:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13863:x1875954691582592:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050155.689890:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13863:x1875954691582592:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 376us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050155.689900:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:2.0:1789050155.697076:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.697301:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582720 00000100:00100000:1.0:1789050155.697313:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582720 00000100:00100000:1.0:1789050155.697392:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:1.0:1789050155.697403:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13863:x1875954691582720:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050155.697744:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13863:x1875954691582720:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 342us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.699262:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:1.0:1789050155.702460:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.702500:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.702531:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.702564:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.702598:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583232 00000100:00100000:1.0:1789050155.702610:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583232 00000100:00100000:3.0:1789050155.702622:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583104 00000100:00100000:3.0:1789050155.702629:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583104 00000100:00100000:1.0:1789050155.702670:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050155.702724:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582848 00000100:00100000:2.0:1789050155.702728:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582848 00000100:00100000:2.0:1789050155.702750:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691582976 00000100:00100000:2.0:1789050155.702753:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691582976 00000100:00100000:2.0:1789050155.702777:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050155.702784:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2348:x1875954691582976:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050155.702864:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2348:x1875954691582976:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 82us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.702872:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050155.702890:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050155.702895:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875954691582848:12345-192.168.206.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789050155.702920:0:14402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f4f0987f-dea0-495c-a722-34140a8b12d4@192.168.206.1@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:2.0:1789050155.702992:0:14402:0:(genops.c:1384:class_connect()) connect: client f4f0987f-dea0-495c-a722-34140a8b12d4, cookie 0x9df728c939b79e47 00000004:00100000:2.0:1789050155.703027:0:14402:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789050155.703321:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691583232:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050155.703357:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691583232:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 678us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050155.703508:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:3.0:1789050155.703522:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691583104:12345-192.168.206.1@tcp:400:kworker.0 00000100:00080000:2.0:1789050155.703549:0:14402:0:(import.c:65:import_set_state_nolock()) ffff95073c7e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050155.703559:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691583104:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 42us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050155.703568:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:2.0:1789050155.703587:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2346:x1875954691582848:12345-192.168.206.1@tcp:38:mount.lustre.0 Request processed in 688us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.703596:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:1.0:1789050155.706771:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:3.0:1789050155.709390:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050155.709436:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050155.709706:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583360 00000100:00100000:0.0:1789050155.709719:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583360 00000100:00080000:3.0:1789050155.709849:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050155.710727:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583488 00000100:00100000:0.0:1789050155.710737:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583488 00000100:00100000:2.0:1789050155.711875:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050155.711896:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+7:0:x1875954691583360:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789050155.711950:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789050155.712050:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+7:0:x1875954691583360:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 164us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.712059:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050155.712096:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:2.0:1789050155.712104:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691583488:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789050155.712115:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789050155.712134:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691583488:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 31us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.712140:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:2.0:1789050155.716046:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050155.716244:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583616 00000100:00100000:3.0:1789050155.716271:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583616 00000100:00100000:3.0:1789050155.716335:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050155.716346:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691583616:12345-192.168.206.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789050155.716442:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691583616:12345-192.168.206.1@tcp:40:mount.lustre.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050155.716451:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050155.721941:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050155.721988:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050155.722123:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583744 00000100:00100000:0.0:1789050155.722135:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583744 00000100:00100000:0.0:1789050155.722189:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691583872 00000100:00100000:0.0:1789050155.722191:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691583872 00000100:00100000:0.0:1789050155.722240:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789050155.722249:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691583744:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050155.722285:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f4f0987f-dea0-495c-a722-34140a8b12d4@192.168.206.1@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1789050155.722324:0:15088:0:(genops.c:1384:class_connect()) connect: client f4f0987f-dea0-495c-a722-34140a8b12d4, cookie 0x9df728c939b79e4e 00002000:00100000:0.0:1789050155.722339:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4f0987f-dea0-495c-a722-34140a8b12d4/ffff950605abd800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050155.722352:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789050155.722635:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789050155.722680:0:15088:0:(import.c:65:import_set_state_nolock()) ffff950605abb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050155.722753:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2346:x1875954691583744:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 503us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050155.722779:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789050155.722800:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:0.0:1789050155.722805:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691583872:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050155.722821:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f4f0987f-dea0-495c-a722-34140a8b12d4@192.168.206.1@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1789050155.722838:0:15088:0:(genops.c:1384:class_connect()) connect: client f4f0987f-dea0-495c-a722-34140a8b12d4, cookie 0x9df728c939b79e55 00002000:00100000:0.0:1789050155.722843:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4f0987f-dea0-495c-a722-34140a8b12d4/ffff950605abc000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050155.722850:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789050155.722997:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789050155.723012:0:15088:0:(import.c:65:import_set_state_nolock()) ffff950605abc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050155.723034:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2346:x1875954691583872:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 228us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050155.723041:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:0.0:1789050155.724790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050155.726291:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584000 00000100:00100000:2.0:1789050155.726308:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584000 00000100:00100000:2.0:1789050155.726414:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:2.0:1789050155.726426:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691584000:12345-192.168.206.1@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789050155.726540:0:14405:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789050155.726660:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13850:x1875954691584000:12345-192.168.206.1@tcp:33:mount.lustre.0 Request processed in 236us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050155.726668:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:2.0:1789050155.877620:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050155.877797:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584128 00000100:00100000:1.0:1789050155.877828:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584128 00000100:00100000:1.0:1789050155.877903:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:1.0:1789050155.877915:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:13884:x1875954691584128:12345-192.168.206.1@tcp:101:mkdir.0 00010000:00010000:1.0:1789050155.877939:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050155.877967:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc69 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878046:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878062:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878091:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050155.878434:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789050155.878438:0:14402:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050155.878467:0:14402:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878499:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b79e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878521:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050155.878531:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050155.878533:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050155.878538:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530400, rc 0) 00000100:00100000:1.0:1789050155.878677:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+7:13884:x1875954691584128:12345-192.168.206.1@tcp:101:mkdir.0 Request processed in 763us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050155.878686:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00010000:00010000:2.0:1789050155.916995:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050156.941472:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050157.963777:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789050158.267539:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00000001:00100000:1.0:1789050158.267556:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00000001:00100000:2.0:1789050158.269122:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00010000:00010000:2.0:1789050158.988379:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050159.246538:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789050159.246561:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704153728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050159.246619:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050159.248355:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050159.248370:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704153856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050159.248420:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050159.248458:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153728 00000100:00100000:3.0:1789050159.248465:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153728 00000100:00100000:3.0:1789050159.248504:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153856 00000100:00100000:3.0:1789050159.248507:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153856 00000100:00100000:3.0:1789050159.248522:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050159.248530:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704153728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050159.248562:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050159.248605:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704153728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050159.248612:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050159.248642:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050159.248649:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704153856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789050159.248666:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050159.249769:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704153856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1119us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050159.249778:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789050159.250001:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050159.250006:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050159.250044:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704153728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050159.250105:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704153856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050159.250709:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050159.250721:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704154112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.250761:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050159.250817:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704154240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.250840:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050159.250868:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154112 00000100:00100000:2.0:1789050159.250874:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154112 00000100:00100000:2.0:1789050159.250906:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154240 00000100:00100000:2.0:1789050159.250908:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154240 00000100:00100000:2.0:1789050159.250936:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050159.250944:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.250984:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704154112:12345-0@lo:400:kworker.0 Request processed in 41us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050159.250990:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050159.251004:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789050159.251011:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.251037:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704154240:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050159.251043:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789050159.251085:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704154240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.251108:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704154112:0@lo:400:kworker.0 00000100:00100000:1.0:1789050159.251267:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704154368:0@lo:400:kworker.0 00000100:00100000:1.0:1789050159.251300:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050159.251321:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050159.251326:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704153984:0@lo:400:kworker.0 00000100:00100000:1.0:1789050159.251352:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050159.251420:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154368 00000100:00100000:2.0:1789050159.251425:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154368 00000100:00100000:2.0:1789050159.251458:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789050159.251464:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.251500:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704154368:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050159.251505:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789050159.251521:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704153984 00000100:00100000:2.0:1789050159.251524:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704153984 00000100:00100000:2.0:1789050159.251549:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789050159.251555:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.251582:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704153984:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050159.251588:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789050159.251617:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704153984:0@lo:400:kworker.0 00000100:00100000:2.0:1789050159.251627:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704154368:0@lo:400:kworker.0 00000100:00080000:3.0:1789050159.251977:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789050159.304845:0:16367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1789050159.380347:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789050159.827034:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00010000:00010000:1.0:1789050160.014817:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050160.847323:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847362:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847396:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847421:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847442:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847463:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847487:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050160.847516:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584768 00000100:00100000:3.0:1789050160.847526:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584768 00000100:00100000:3.0:1789050160.847579:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584384 00000100:00100000:3.0:1789050160.847582:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584384 00000100:00100000:3.0:1789050160.847604:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050160.847613:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2347:x1875954691584768:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.847681:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2347:x1875954691584768:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.847688:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050160.847704:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:3.0:1789050160.847711:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691584384:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.847749:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691584384:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.847755:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:3.0:1789050160.847774:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584512 00000100:00100000:3.0:1789050160.847777:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584512 00000100:00100000:3.0:1789050160.847796:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585024 00000100:00100000:3.0:1789050160.847799:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585024 00000100:00100000:3.0:1789050160.847810:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584640 00000100:00100000:3.0:1789050160.847812:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584640 00000100:00100000:3.0:1789050160.847822:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584896 00000100:00100000:3.0:1789050160.847824:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584896 00000100:00100000:3.0:1789050160.847837:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050160.847843:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691584512:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.847867:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691584512:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.847873:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050160.847885:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050160.847890:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691585024:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.847912:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691585024:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 22us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.847918:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050160.847928:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050160.847934:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691584640:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.847955:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691584640:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 22us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.847971:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050160.847983:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050160.847989:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691584896:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050160.848012:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691584896:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050160.848017:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00080000:3.0:1789050160.848060:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789050160.848064:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050160.848066:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050160.848348:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691584256 00000100:00100000:1.0:1789050160.848353:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691584256 00000100:00100000:1.0:1789050160.848382:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 104 00000100:00100000:1.0:1789050160.848389:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2347:x1875954691584256:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050160.848419:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2347:x1875954691584256:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 31us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050160.848425:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 104 00010000:00010000:2.0:1789050161.037729:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050162.060341:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789050162.676026:0:16515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff26d661a0 20000000:00000080:1.0:1789050162.676126:0:16515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950606aec400 uarg=0000000000000000 20000000:01000000:1.0:1789050162.676164:0:16515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789050162.676169:0:16515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789050162.676174:0:16515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789050162.677134:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789050162.678744:0:16515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789050162.693528:0:16515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789050162.694692:0:16515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694713:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79b5a expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694722:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694729:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694740:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694772:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694782:0:16515:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694823:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.694839:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 12 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.694855:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154496:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050162.695622:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.695634:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 12 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.695644:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154624:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050162.695677:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.695685:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.695694:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154752:0@lo:104: 00000100:00100000:0.0:1789050162.695733:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050162.695799:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154752 00000100:00100000:1.0:1789050162.695807:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154752 00000100:00100000:1.0:1789050162.695860:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050162.695870:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:16515:x1875954704154752:12345-0@lo:104: 00010000:00010000:1.0:1789050162.695882:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.696163:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.696173:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 18 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.696181:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154880:0@lo:104: 00000100:00100000:0.0:1789050162.696231:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050162.696258:0:14385:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789050162.696265:0:14385:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789050162.696290:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.696298:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 18 pid: 14395 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.696306:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704155008:0@lo:104: 00000100:00100000:0.0:1789050162.696330:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050162.696339:0:16515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050162.700670:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050162.700870:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154496:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050162.701180:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050162.701239:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585152 00000100:00100000:0.0:1789050162.701247:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585152 00010000:00010000:0.0:1789050162.701284:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 13 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.701317:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585280 00000100:00100000:0.0:1789050162.701321:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585280 00010000:00010000:0.0:1789050162.701333:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 14 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.701347:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:0.0:1789050162.701365:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+14:2348:x1875954691585152:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050162.701379:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050162.701385:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 14 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701397:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 14 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701415:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c531e00/0x9df728c939b79e40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc3f expref: 14 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050162.701424:0:14387:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789050162.701430:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050162.701435:0:14387:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789050162.701480:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2348:x1875954691585152:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 116us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.701487:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:0.0:1789050162.701507:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:0.0:1789050162.701514:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2348:x1875954691585280:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050162.701523:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050162.701538:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 12 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701548:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 12 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701559:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050162.701585:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2348:x1875954691585280:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 71us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.701592:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:0.0:1789050162.701630:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704154880 00000100:00100000:0.0:1789050162.701634:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704154880 00000100:00100000:0.0:1789050162.701667:0:14385:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789050162.701685:0:14385:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789050162.701694:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155008 00000100:00100000:0.0:1789050162.701697:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155008 00000100:00100000:2.0:1789050162.701758:0:16517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050162.701767:0:16517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:16515:x1875954704154880:12345-0@lo:104: 00010000:00010000:2.0:1789050162.701778:0:16517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701847:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050162.701854:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+5:16515:x1875954704154752:12345-0@lo:104: Request processed in 5986us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.701861:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789050162.701879:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050162.701885:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701892:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050162.701896:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701906:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050162.701913:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050162.701919:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050162.701966:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.701973:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050162.701998:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702016:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531000/0x9df728c939b79c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79c1e expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702036:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.702039:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.702040:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050162.702062:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704155136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050162.702098:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050162.702142:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155136 00000100:00100000:0.0:1789050162.702146:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155136 00010000:00010000:0.0:1789050162.702160:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.702178:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050162.702184:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950605753850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3285:x1875954704155136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050162.702192:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050162.702195:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702224:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702235:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050162.702269:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950605753850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3285:x1875954704155136:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.702276:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050162.702333:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704155136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050162.702368:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050162.702376:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c1c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+4:16515:x1875954704155008:12345-0@lo:104: 00010000:00010000:0.0:1789050162.702386:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702427:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050162.702433:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c1c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+4:16515:x1875954704155008:12345-0@lo:104: Request processed in 59us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.702439:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789050162.702453:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050162.702458:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702465:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050162.702468:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702476:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050162.702482:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050162.702488:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050162.702508:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702513:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050162.702531:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702546:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b79b5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79b61 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702557:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.702559:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.702560:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050162.702572:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704155264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050162.702601:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050162.702641:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155264 00000100:00100000:0.0:1789050162.702646:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155264 00010000:00010000:0.0:1789050162.702662:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 19 pid: 14395 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050162.702682:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789050162.702689:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704155264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050162.702698:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050162.702702:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 19 pid: 14395 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702711:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 19 pid: 14395 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.702722:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050162.702752:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704155264:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050162.702758:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789050162.702781:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704155264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050162.703000:0:16517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050162.703008:0:16517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+3:16515:x1875954704154880:12345-0@lo:104: Request processed in 1241us (6775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050162.703014:0:16517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789050162.703372:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050162.703379:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.703388:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050162.703391:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.703399:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050162.703407:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050162.703412:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050162.703485:0:15850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.703492:0:15850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050162.703515:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050162.703522:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950605f07a00/0x9df728c939b79ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b79bae expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050162.703536:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704155392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050162.703536:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.703540:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050162.703543:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050162.703637:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050162.703914:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155392 00000100:00100000:1.0:1789050162.703921:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155392 00010000:00010000:1.0:1789050162.703944:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050162.703988:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050162.703997:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704155392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050162.704009:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050162.704014:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704023:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 19 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704057:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704065:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704078:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704086:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704092:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704098:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704104:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050162.704108:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704121:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704130:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050162.704139:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050162.704174:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704155392:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050162.704181:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050162.704235:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704155392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050162.704995:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c50400/0x9df728c939b79e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbdd expref: 11 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050162.705009:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154624:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050162.705025:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b79c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79c17 expref: 18 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050162.705165:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154752:0@lo:104: 00010000:00010000:3.0:1789050162.705181:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51800/0x9df728c939b79bae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79ba7 expref: 17 pid: 14396 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050162.705189:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704154880:0@lo:104: 00010000:00010000:3.0:1789050162.705364:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c530800/0x9df728c939b79b61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b79b5a expref: 16 pid: 14395 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050162.705387:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875954704155008:0@lo:104: 00010000:00010000:3.0:1789050162.705421:0:16515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050162.705431:0:16515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050162.705438:0:16515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050162.705443:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330400/0x9df728c939b79e6a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.084018:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789050163.854299:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050163.854306:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950604d74800 from 10 10000000:01000000:0.0:1789050163.854311:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050163.854349:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.854360:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.854372:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050163.854395:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.854453:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050163.854536:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507207d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050163.854577:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155520 00000100:00100000:2.0:1789050163.854584:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155520 00000100:00100000:2.0:1789050163.854668:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789050163.854678:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:14398:x1875954704155520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050163.854690:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050163.854702:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50200/0x9df728c939b79e78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79e71 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.854723:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50200/0x9df728c939b79e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79e71 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.854734:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50200/0x9df728c939b79e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79e71 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.854742:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050163.854801:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050163.854808:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789050163.854884:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050163.854900:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050163.854910:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050163.854961:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050163.854990:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050163.855015:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050163.855308:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155648 00000100:00100000:2.0:1789050163.855313:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155648 00000100:00100000:2.0:1789050163.855370:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789050163.855378:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050163.855602:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050163.855615:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789050163.855629:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050163.855659:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050163.855697:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050163.855797:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155776 00000100:00100000:3.0:1789050163.855801:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050163.855809:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155776 00000100:00100000:0.0:1789050163.855830:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789050163.855836:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.855992:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050163.855999:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789050163.856080:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789050163.856989:0:16557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789050163.857294:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789050163.857311:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050163.857320:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.857330:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050163.857340:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050163.857342:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950604dbf800 from 10 10000000:01000000:1.0:1789050163.857345:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050163.857371:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.857378:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.857578:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050163.857602:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.857644:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050163.857680:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789050163.857725:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704155904 00000100:00100000:0.0:1789050163.857731:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704155904 00000100:00100000:0.0:1789050163.857802:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789050163.857812:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:14398:x1875954704155904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050163.857822:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050163.857832:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330c00/0x9df728c939b79e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79e7f expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.857853:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330c00/0x9df728c939b79e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79e7f expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.857862:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330c00/0x9df728c939b79e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79e7f expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.857870:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:0.0:1789050163.857912:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:14398:x1875954704155904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050163.857918:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789050163.857981:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704155904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050163.857996:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050163.858005:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050163.858056:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050163.858086:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050163.858110:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050163.858231:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156032 00000100:00100000:0.0:1789050163.858236:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156032 00000100:00100000:0.0:1789050163.858261:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789050163.858268:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:14398:x1875954704156032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.859355:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.859394:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.859497:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050163.859531:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050163.859574:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156160 00000100:00100000:2.0:1789050163.859580:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156160 00000100:00100000:2.0:1789050163.859619:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789050163.859626:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050163.859768:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050163.859775:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789050163.859816:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.860107:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:14398:x1875954704156032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1838us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050163.860116:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000040:00080000:2.0:1789050163.860994:0:16559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789050163.861158:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789050163.861176:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050163.861185:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.861397:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050163.861411:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050163.861414:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950605aa8800 from 10 10000000:01000000:1.0:1789050163.861417:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050163.861445:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.861454:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.861464:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050163.861485:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.861541:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050163.861609:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050163.861644:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156288 00000100:00100000:2.0:1789050163.861650:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156288 00000100:00100000:2.0:1789050163.861718:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789050163.861727:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:14398:x1875954704156288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050163.861737:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050163.861750:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50800/0x9df728c939b79e94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b79e8d expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.861769:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50800/0x9df728c939b79e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b79e8d expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.861779:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50800/0x9df728c939b79e94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b79e8d expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050163.861788:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50800, rc 0) 00000100:00100000:2.0:1789050163.861838:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050163.861856:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789050163.861919:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050163.861933:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.861941:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050163.861990:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.862018:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050163.862148:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156416 00000100:00100000:1.0:1789050163.862152:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156416 00000100:00100000:1.0:1789050163.862170:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789050163.862175:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050163.862473:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050163.862480:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789050163.862650:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c5206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050163.862665:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.862692:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050163.862730:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050163.862757:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c5206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050163.862797:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156544 00000100:00100000:2.0:1789050163.862803:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156544 00000100:00100000:2.0:1789050163.862836:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789050163.862844:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050163.862983:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:14398:x1875954704156544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050163.862990:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789050163.863065:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:14398:1875954704156544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789050163.863883:0:16560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789050163.864040:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789050163.864058:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050163.864067:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050163.864077:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050163.989384:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050163.989471:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585408 00000100:00100000:0.0:1789050163.989480:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585408 00000100:00100000:0.0:1789050163.989531:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:0.0:1789050163.989541:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:13736:x1875954691585408:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050163.989555:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050163.989582:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331000/0x9df728c939b79e9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc70 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.989608:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331000/0x9df728c939b79e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc70 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.989619:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331000/0x9df728c939b79e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc70 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050163.989627:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331000, rc 0) 00000100:00100000:0.0:1789050163.989684:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585408:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050163.989691:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 114 00000100:00100000:1.0:1789050164.005072:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050164.005544:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585536 00000100:00100000:0.0:1789050164.005554:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585536 00000100:00100000:0.0:1789050164.005608:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:0.0:1789050164.005617:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585536:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050164.005939:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585536:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 322us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.005947:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 115 00000100:00100000:0.0:1789050164.013107:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050164.013420:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585664 00000100:00100000:2.0:1789050164.013430:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585664 00000100:00100000:2.0:1789050164.013513:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:2.0:1789050164.013522:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585664:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050164.013721:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585664:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 199us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050164.013729:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 116 00000100:00100000:2.0:1789050164.024628:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050164.024712:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585792 00000100:00100000:3.0:1789050164.024721:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585792 00000100:00100000:3.0:1789050164.024773:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:3.0:1789050164.024782:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:13736:x1875954691585792:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050164.024798:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050164.024814:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95070f05e000/0x9df728c939b79ea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc77 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050164.024882:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95070f05e000/0x9df728c939b79ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc77 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050164.024894:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95070f05e000/0x9df728c939b79ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc77 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050164.024903:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e000, rc 0) 00000100:00100000:3.0:1789050164.025097:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13736:x1875954691585792:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 315us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050164.025104:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 117 00000100:00100000:2.0:1789050164.030988:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050164.031036:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691585920 00000100:00100000:2.0:1789050164.031045:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691585920 00000100:00100000:2.0:1789050164.031096:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:2.0:1789050164.031269:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13736:x1875954691585920:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050164.031731:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13736:x1875954691585920:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 464us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050164.031739:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 118 00000100:00100000:2.0:1789050164.035292:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050164.036862:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586048 00000100:00100000:1.0:1789050164.036872:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586048 00000100:00100000:1.0:1789050164.036919:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 119 00000100:00100000:1.0:1789050164.036928:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13736:x1875954691586048:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050164.037940:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:13736:x1875954691586048:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 203us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050164.037950:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 119 00010000:00010000:2.0:1789050164.109903:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050164.363553:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704156672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050164.363632:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050164.363718:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156672 00000100:00100000:0.0:1789050164.363726:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156672 00000100:00100000:1.0:1789050164.363754:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050164.363766:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704156800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050164.363786:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789050164.363798:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704156672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050164.363814:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789050164.363850:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050164.363940:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704156672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050164.364078:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704156672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 282us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.364087:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789050164.364105:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156800 00000100:00100000:0.0:1789050164.364109:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156800 00000100:00100000:0.0:1789050164.364128:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789050164.364135:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704156800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050164.364153:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050164.364220:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704156800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.364227:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789050164.364244:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050164.364247:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050164.364355:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704156800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050164.364970:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704157312:0@lo:400:kworker.0 00000100:00100000:0.0:1789050164.365008:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050164.365045:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050164.365053:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704157184:0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.365058:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704157056:0@lo:400:kworker.0 00000100:00100000:0.0:1789050164.365081:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050164.365103:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050164.365139:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789050164.365145:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704156928:0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.365174:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050164.366324:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157312 00000100:00100000:0.0:1789050164.366333:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157312 00000100:00100000:0.0:1789050164.366439:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157184 00000100:00100000:0.0:1789050164.366443:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157184 00000100:00080000:1.0:1789050164.366474:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050164.366550:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704157056 00000100:00100000:0.0:1789050164.366554:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704157056 00000100:00100000:0.0:1789050164.366579:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789050164.366589:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704157312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.366642:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050164.366654:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704157184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050164.366669:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704157312:12345-0@lo:400:kworker.0 Request processed in 81us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.366677:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789050164.366702:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789050164.366703:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704157184:12345-0@lo:400:kworker.0 Request processed in 48us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.366711:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704157056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.366714:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050164.366746:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704156928 00000100:00100000:2.0:1789050164.366750:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704156928 00000100:00100000:0.0:1789050164.366756:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704157056:12345-0@lo:400:kworker.0 Request processed in 47us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050164.366763:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789050164.366785:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789050164.366794:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704156928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050164.366816:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704157184:0@lo:400:kworker.0 00000100:00100000:0.0:1789050164.366833:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704157312:0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.366838:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704156928:12345-0@lo:400:kworker.0 Request processed in 44us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050164.366846:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789050164.366892:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704156928:0@lo:400:kworker.0 00000100:00100000:2.0:1789050164.366904:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704157056:0@lo:400:kworker.0 00010000:00010000:0.0:1789050165.131379:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050165.966573:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966632:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966671:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966710:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966750:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966769:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050165.966793:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586432 00000100:00100000:1.0:1789050165.966802:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586432 00000100:00100000:2.0:1789050165.966808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050165.966836:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586560 00000100:00100000:2.0:1789050165.966842:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586560 00000100:00100000:1.0:1789050165.966870:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586816 00000100:00100000:2.0:1789050165.966874:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586944 00000100:00100000:1.0:1789050165.966875:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586816 00000100:00100000:2.0:1789050165.966881:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586944 00000100:00100000:1.0:1789050165.966906:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:1.0:1789050165.966924:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691586432:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050165.966990:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691586432:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 75us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050165.967044:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586304 00000100:00100000:3.0:1789050165.967049:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586304 00000100:00100000:0.0:1789050165.967056:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586176 00000100:00100000:0.0:1789050165.967063:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586176 00000100:00100000:3.0:1789050165.967084:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691586688 00000100:00100000:3.0:1789050165.967089:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691586688 00000100:00100000:0.0:1789050165.967104:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:0.0:1789050165.967114:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2348:x1875954691586176:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050165.967120:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:3.0:1789050165.967132:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691586304:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050165.967148:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2348:x1875954691586176:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 35us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050165.967156:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:3.0:1789050165.967171:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691586304:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 40us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050165.967178:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:0.0:1789050165.967224:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:0.0:1789050165.967234:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2348:x1875954691586688:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050165.967268:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2348:x1875954691586688:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050165.967273:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00080000:0.0:1789050165.967314:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789050165.967326:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050165.967328:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789050165.967405:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050165.967415:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691586560:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050165.967444:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2347:x1875954691586560:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 32us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050165.967452:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050165.967470:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050165.967478:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691586816:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050165.967491:0:15848:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789050165.967500:0:15848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789050165.967512:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691586816:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 35us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050165.967520:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050165.967534:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050165.967541:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2348:x1875954691586944:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050165.967567:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2348:x1875954691586944:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 27us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050165.967574:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:1.0:1789050165.974540:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050166.080119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.087225:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587072 00000100:00100000:3.0:1789050166.087240:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587072 00000100:00100000:3.0:1789050166.087389:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050166.087400:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:14396:x1875954691587072:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050166.087419:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050166.087442:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc7e expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087506:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087520:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087533:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087565:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087573:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087580:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087880:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087890:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087897:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050166.087920:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050166.087924:0:14401:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050166.087955:0:14401:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087965:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087972:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087979:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.087994:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050166.087999:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088006:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088033:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050166.088036:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050166.088042:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088048:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79eb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088061:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088067:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088072:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088077:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050166.088080:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088085:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088103:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9507102a3900) 00010000:00010000:3.0:1789050166.088105:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050166.088108:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088113:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79eb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088145:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc7e expref: 8 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088158:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc7e expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.088165:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507102a3b00) 00010000:00010000:3.0:1789050166.088167:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050166.088169:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f600, rc 0) 00000100:00100000:3.0:1789050166.088352:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+7:14396:x1875954691587072:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 953us (8241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050166.088360:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789050166.101916:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.102134:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587328 00000100:00100000:0.0:1789050166.102143:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587328 00000100:00100000:0.0:1789050166.102195:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050166.102228:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+7:14396:x1875954691587328:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050166.102247:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050166.102273:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79ec5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc85 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102356:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102370:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102381:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102442:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102450:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102457:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102848:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79eda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102868:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79eda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.102875:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79eda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050166.102886:0:16279:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789050166.103149:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103157:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103164:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103169:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.103173:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103180:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103191:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507102a3b00) 00010000:00010000:0.0:1789050166.103194:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.103226:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103233:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ecc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103246:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103258:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103263:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103268:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.103271:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103276:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103284:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff950714b52f00) 00010000:00010000:0.0:1789050166.103287:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.103290:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103296:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79ed3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103810:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79ec5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc85 expref: 10 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103826:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79eda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc85 expref: 9 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.103832:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950714b52a00) 00010000:00010000:0.0:1789050166.103834:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.103842:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331600, rc 0) 00000100:00100000:0.0:1789050166.105107:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14396:x1875954691587328:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1684us (2003us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789050166.105118:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:1.0:1789050166.106470:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.106510:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587456 00000100:00100000:0.0:1789050166.106520:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587456 00000100:00100000:0.0:1789050166.106575:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:0.0:1789050166.106584:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14396:x1875954691587456:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789050166.106677:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14396:x1875954691587456:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050166.106684:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00010000:00010000:0.0:1789050166.155353:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050166.164652:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.167356:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587584 00000100:00100000:0.0:1789050166.167371:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587584 00000100:00100000:0.0:1789050166.167455:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:0.0:1789050166.167466:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14402:x1875954691587584:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050166.167486:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050166.167505:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc8c expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167565:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167579:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167589:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167620:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167628:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.167635:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169134:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169148:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169154:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169160:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.169164:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169171:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169187:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.169190:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.169195:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169218:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b79eef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169241:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169246:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169253:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169258:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.169261:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169266:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169274:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff950714b52f00) 00010000:00010000:0.0:1789050166.169276:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.169279:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169284:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330000/0x9df728c939b79ef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169324:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79ee8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc8c expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169336:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.169338:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.169348:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc8c expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.169357:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330800, rc 0) 00000100:00100000:0.0:1789050166.170414:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14402:x1875954691587584:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2943us (5765us total) trans 0 rc 301/301 00000100:00100000:0.0:1789050166.170424:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:2.0:1789050166.182840:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.182980:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587712 00000100:00100000:3.0:1789050166.182989:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587712 00000100:00100000:3.0:1789050166.183055:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050166.183065:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14402:x1875954691587712:12345-192.168.206.1@tcp:700:lfs.0 00000100:00100000:3.0:1789050166.183145:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14402:x1875954691587712:12345-192.168.206.1@tcp:700:lfs.0 Request processed in 81us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050166.183152:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:1.0:1789050166.189080:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.189795:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691587968 00000100:00100000:0.0:1789050166.189806:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691587968 00000100:00100000:0.0:1789050166.189867:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:0.0:1789050166.189877:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14402:x1875954691587968:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:0.0:1789050166.189939:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050166.189963:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc07 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.189982:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.189987:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050166.190270:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.190285:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 5 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.190293:0:14402:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.190417:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 5 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.190431:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 5 pid: 14402 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050166.190444:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875954704157440:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050166.190539:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9506010fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050166.194285:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050166.194390:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875954704157440:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050166.194418:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050166.194929:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588096 00000100:00100000:0.0:1789050166.194936:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588096 00010000:00010000:0.0:1789050166.194973:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 6 pid: 14402 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050166.195037:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:0.0:1789050166.195047:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2347:x1875954691588096:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050166.195068:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050166.195076:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 6 pid: 14402 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195088:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 6 pid: 14402 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195119:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b79e63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc69 expref: 6 pid: 14402 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195135:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.195140:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195149:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195156:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.195188:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050166.195264:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2347:x1875954691588096:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 218us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050166.195271:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00010000:00010000:2.0:1789050166.195555:0:14402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.195564:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.195587:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.195597:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.195604:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.199694:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050166.199723:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199733:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199741:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199747:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.199751:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199759:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199787:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.199790:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.199795:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.199802:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b79efd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050166.199823:0:14402:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f8949c35 reply state 000000009af91d7d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050166.199831:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050166.199939:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14402:x1875954691587968:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 10060us (10864us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789050166.199948:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00010000:00010000:3.0:1789050166.206427:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206445:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206453:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206459:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050166.206464:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206471:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206487:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95072c9b1200) 00010000:00010000:3.0:1789050166.206491:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050166.206496:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.206502:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f04 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050166.305990:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.306497:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588224 00000100:00100000:2.0:1789050166.306510:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588224 00000100:00100000:2.0:1789050166.306577:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789050166.306597:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+9:14410:x1875954691588224:12345-192.168.206.1@tcp:101:lctl.0 00010000:00010000:2.0:1789050166.306719:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.306743:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc93 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306807:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306821:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306851:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.306885:0:16279:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050166.306889:0:16279:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050166.306927:0:16279:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306963:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc93 expref: 11 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306982:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc93 expref: 10 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.306990:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.306992:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050166.306995:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51800, rc 0) 00000100:00100000:2.0:1789050166.307071:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14410:x1875954691588224:12345-192.168.206.1@tcp:101:lctl.0 Request processed in 477us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.307078:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789050166.324885:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.324993:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588352 00000100:00100000:3.0:1789050166.325004:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588352 00000100:00100000:3.0:1789050166.325115:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050166.325125:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:14411:x1875954691588352:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050166.325145:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050166.325165:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fc9a expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325284:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325298:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325310:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050166.325357:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050166.325360:0:14401:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050166.325378:0:14401:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325403:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc9a expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325420:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc9a expref: 6 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.325428:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:3.0:1789050166.325431:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050166.325434:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05e600, rc 0) 00000100:00100000:3.0:1789050166.325501:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:14411:x1875954691588352:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 378us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050166.325508:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:0.0:1789050166.330469:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.330938:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588480 00000100:00100000:2.0:1789050166.330948:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588480 00000100:00100000:2.0:1789050166.331021:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:2.0:1789050166.331676:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:14411:x1875954691588480:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050166.331698:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.331717:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fca1 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331871:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331885:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331896:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331911:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331919:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.331926:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332249:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332258:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332264:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.332293:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050166.332297:0:14403:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050166.332314:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332338:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332344:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332350:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332356:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.332359:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332367:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332377:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.332380:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.332385:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332391:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332403:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332409:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.332415:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334103:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.334114:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334122:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334138:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050166.334142:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.334146:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334153:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334220:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fca1 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334234:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fca1 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.334241:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1100) 00010000:00010000:2.0:1789050166.334244:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050166.334246:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50000, rc 0) 00000100:00100000:2.0:1789050166.334336:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+7:14411:x1875954691588480:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 2669us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.334344:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:1.0:1789050166.340969:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.341113:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588736 00000100:00100000:2.0:1789050166.341130:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588736 00000100:00100000:2.0:1789050166.341348:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050166.341359:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+7:14411:x1875954691588736:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050166.341377:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.341395:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fca8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.341494:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050166.341616:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fca8 expref: 9 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.341630:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.341633:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050166.341637:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b79f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fca8 expref: 9 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.341648:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50400, rc 0) 00000100:00100000:2.0:1789050166.341696:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+8:14411:x1875954691588736:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 339us (741us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789050166.341703:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:0.0:1789050166.345077:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.348775:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691588992 00000100:00100000:3.0:1789050166.348789:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691588992 00000100:00100000:3.0:1789050166.348866:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:3.0:1789050166.348876:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4f0987f-dea0-495c-a722-34140a8b12d4+8:14411:x1875954691588992:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:3.0:1789050166.348927:0:16279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050166.348954:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b79f3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fca1 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.348974:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1100) 00010000:00010000:3.0:1789050166.348983:0:16279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050166.349006:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.349038:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.349048:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050166.349442:0:16279:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000030c7984a reply state 00000000b196c282 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050166.349451:0:16279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789050166.349459:0:16279:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789050166.349546:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4f0987f-dea0-495c-a722-34140a8b12d4+9:14411:x1875954691588992:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 671us (4478us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789050166.349555:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00010000:00010000:2.0:1789050166.351695:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351711:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351719:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351743:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.351759:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351768:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351784:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9507102a3900) 00010000:00010000:2.0:1789050166.351788:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789050166.351793:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.351799:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f000/0x9df728c939b79f51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050166.354070:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.354146:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691589248 00000100:00100000:2.0:1789050166.354155:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691589248 00000100:00100000:2.0:1789050166.354254:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050166.354265:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+8:14411:x1875954691589248:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050166.354277:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789050166.354288:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789050166.354495:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+9:14411:x1875954691589248:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 231us (432us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789050166.354504:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:0.0:1789050166.357952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.358028:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691589504 00000100:00100000:3.0:1789050166.358037:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691589504 00000100:00100000:3.0:1789050166.358101:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:3.0:1789050166.358124:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+9:14411:x1875954691589504:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050166.358149:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050166.358170:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcaf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359121:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359143:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359157:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359173:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359181:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.359188:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050166.360248:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789050166.360344:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360355:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360363:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360369:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.360374:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360395:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360410:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.360414:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.360419:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360426:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b79f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360441:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360447:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360453:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.360458:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050166.360460:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363430:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363450:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff950714b52f00) 00010000:00010000:0.0:1789050166.363453:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050166.363459:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363503:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b79f66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363591:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79f58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcaf expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363603:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:0.0:1789050166.363605:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050166.363609:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f800/0x9df728c939b79f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcaf expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.363619:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95070f05f800, rc 0) 00000100:00100000:0.0:1789050166.363692:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+10:14411:x1875954691589504:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 5571us (5750us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789050166.363700:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:1.0:1789050166.372570:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.374250:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691589632 00000100:00100000:2.0:1789050166.374267:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691589632 00000100:00100000:2.0:1789050166.374332:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:2.0:1789050166.374343:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+10:14411:x1875954691589632:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050166.374367:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.374402:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcb6 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.374843:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.374857:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.374869:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.374897:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050166.374901:0:14403:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050166.374918:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.374945:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b79f74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.374960:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.375333:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050166.375337:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050166.375342:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050166.375402:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+11:14411:x1875954691589632:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1060us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.375410:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:2.0:1789050166.386909:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.387038:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691589760 00000100:00100000:0.0:1789050166.387047:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691589760 00000100:00100000:0.0:1789050166.387104:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:0.0:1789050166.387115:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+11:14411:x1875954691589760:12345-192.168.206.1@tcp:37:lfs.0 00000100:00100000:2.0:1789050166.394034:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+11:14411:x1875954691589760:12345-192.168.206.1@tcp:37:lfs.0 Request processed in 6912us (7123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.394046:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:1.0:1789050166.398944:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.399031:0:16631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590016 00000100:00100000:3.0:1789050166.399040:0:16631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590016 00000100:00100000:3.0:1789050166.399102:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050166.399114:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507101b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+11:14411:x1875954691590016:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050166.399399:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507101b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+12:14411:x1875954691590016:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 286us (463us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789050166.399407:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:0.0:1789050166.446926:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.447336:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590144 00000100:00100000:2.0:1789050166.447346:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590144 00000100:00100000:2.0:1789050166.447403:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050166.447413:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14417:x1875954691590144:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050166.447432:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.447452:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcbd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447516:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447530:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447540:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447553:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447559:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447565:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.447665:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448141:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448149:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.448180:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050166.448184:0:14402:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050166.448267:0:14402:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448279:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448287:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448293:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448299:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.448303:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448310:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448322:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.448325:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.448329:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448347:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448360:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448367:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448373:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448378:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.448382:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448387:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448393:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050166.448395:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.448398:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448403:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448435:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b79f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcbd expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448460:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcbd expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.448467:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050166.448470:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050166.448472:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50600, rc 0) 00000100:00100000:2.0:1789050166.448537:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14417:x1875954691590144:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1125us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.448545:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050166.452970:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.453049:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590400 00000100:00100000:3.0:1789050166.453058:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590400 00000100:00100000:3.0:1789050166.453115:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:3.0:1789050166.453124:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14417:x1875954691590400:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050166.453142:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050166.453162:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fc00/0x9df728c939b79f9e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcc4 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.453311:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.453325:0:16279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.453334:0:16279:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.453378:0:16279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.453392:0:16279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 11 pid: 14403 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050166.453404:0:16279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704157568:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050166.453476:0:16279:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050166.456716:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.456860:0:16279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c21b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704157568:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050166.456889:0:16279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050166.456963:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590528 00000100:00100000:0.0:1789050166.456970:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590528 00010000:00010000:0.0:1789050166.457017:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 12 pid: 14403 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050166.457059:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789050166.457068:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+12:2347:x1875954691590528:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050166.457096:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050166.457103:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 12 pid: 14403 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457115:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 12 pid: 14403 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457135:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79f7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcb6 expref: 12 pid: 14403 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457150:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:0.0:1789050166.457155:0:14387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457164:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457172:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.457244:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050166.457288:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+11:2347:x1875954691590528:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 221us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050166.457296:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00010000:00010000:3.0:1789050166.457489:0:16279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.457497:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.457518:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.457528:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.457536:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459678:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459694:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459705:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.459716:0:16279:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050166.459739:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459746:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459753:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459774:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05fa00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.459779:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459786:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459797:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050166.459800:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050166.459804:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459810:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fa00/0x9df728c939b79fa5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050166.459823:0:16279:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007c88ab01 reply state 000000002a7efc89 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050166.459831:0:16279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789050166.459861:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05fc00/0x9df728c939b79f9e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459873:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 13 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.459880:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050166.459883:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789050166.459885:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50a00, rc 0) 00000100:00100000:2.0:1789050166.459946:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+14:14417:x1875954691590400:12345-192.168.206.1@tcp:101:bash.0 Request processed in 6823us (6983us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789050166.459959:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 28 00010000:00010000:3.0:1789050166.464926:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.464955:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.464963:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.464968:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050166.464973:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.464981:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.464997:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9507102a3500) 00010000:00010000:3.0:1789050166.465001:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050166.465005:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050166.465021:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b79fac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050166.474999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.475469:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590656 00000100:00100000:0.0:1789050166.475479:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590656 00000100:00100000:1.0:1789050166.475830:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:1.0:1789050166.475842:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14417:x1875954691590656:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050166.475868:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050166.475889:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79fc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fccb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.475963:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.475978:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.475990:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050166.476050:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789050166.476055:0:14401:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050166.476077:0:14401:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.476087:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.476110:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b79fc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fccb expref: 15 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.476127:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fccb expref: 14 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050166.476152:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:1.0:1789050166.476154:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050166.476158:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531e00, rc 0) 00000100:00100000:1.0:1789050166.476264:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+14:14417:x1875954691590656:12345-192.168.206.1@tcp:101:bash.0 Request processed in 424us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050166.476272:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:1.0:1789050166.480909:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.481003:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691590912 00000100:00100000:2.0:1789050166.481021:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691590912 00000100:00100000:2.0:1789050166.481084:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:2.0:1789050166.481094:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+14:14417:x1875954691590912:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:2.0:1789050166.481396:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1789050166.481568:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14417:x1875954691590912:12345-192.168.206.1@tcp:35:bash.0 Request processed in 474us (667us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789050166.481576:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000020:00080000:2.0:1789050166.481581:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789050166.540000:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789050166.603128:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.607163:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691591168 00000100:00100000:2.0:1789050166.607184:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691591168 00000100:00100000:2.0:1789050166.607305:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:2.0:1789050166.607328:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14428:x1875954691591168:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050166.607358:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.607395:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcd2 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.607505:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050166.607673:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79fcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcd2 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.607690:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050166.607693:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050166.607715:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcd2 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.607732:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050166.607819:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14428:x1875954691591168:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 503us (4705us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1789050166.607827:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:2.0:1789050166.611966:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.612088:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691591424 00000100:00100000:3.0:1789050166.612100:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691591424 00000100:00100000:3.0:1789050166.612173:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050166.612185:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14428:x1875954691591424:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050166.612540:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+18:14428:x1875954691591424:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 357us (595us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789050166.612549:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050166.657545:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050166.657675:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691591680 00000100:00100000:2.0:1789050166.657689:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691591680 00000100:00100000:2.0:1789050166.657761:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:2.0:1789050166.657773:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+18:14431:x1875954691591680:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050166.657806:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050166.657836:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79fdd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcd9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.658004:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79fe4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.658031:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.658046:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050166.658060:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050166.658274:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79fdd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcd9 expref: 21 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.658297:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcd9 expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.658315:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050166.658427:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050166.658433:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050166.658504:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+20:14431:x1875954691591680:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 733us (973us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789050166.658514:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:1.0:1789050166.663644:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050166.663730:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050166.663872:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691591936 00000100:00100000:0.0:1789050166.663885:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691591936 00000100:00100000:0.0:1789050166.663982:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:0.0:1789050166.663997:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+20:2349:x1875954691591936:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050166.664027:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050166.664059:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b79fe4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcd9 expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050166.664082:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:0.0:1789050166.664088:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050166.664161:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+19:2349:x1875954691591936:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 168us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050166.664168:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:2.0:1789050166.664661:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691591808 00000100:00100000:2.0:1789050166.664668:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691591808 00000100:00100000:2.0:1789050166.664716:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:2.0:1789050166.664727:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+19:14431:x1875954691591808:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:2.0:1789050166.664796:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664814:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664827:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664856:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664864:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664871:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664879:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050166.664896:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664905:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664917:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050166.664921:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050166.664925:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050166.664932:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b79ff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050166.664987:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+19:14431:x1875954691591808:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 262us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050166.664995:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:0.0:1789050166.669945:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050166.670701:0:16631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691592192 00000100:00100000:3.0:1789050166.670732:0:16631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691592192 00000100:00100000:3.0:1789050166.670809:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050166.670822:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+19:14431:x1875954691592192:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050166.673044:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+20:14431:x1875954691592192:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 2207us (3097us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789050166.673062:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050167.109690:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.109868:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691592448 00000100:00100000:2.0:1789050167.109883:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691592448 00000100:00100000:2.0:1789050167.109973:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:2.0:1789050167.109987:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+20:14462:x1875954691592448:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:2.0:1789050167.110027:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050167.110054:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79ff9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fce0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.110182:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a000 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.110247:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.110287:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050167.110304:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050167.110486:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b79ff9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce0 expref: 23 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.110509:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a000 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce0 expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.110519:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.110522:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050167.110527:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050167.110613:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+22:14462:x1875954691592448:12345-192.168.206.1@tcp:101:cat.0 Request processed in 629us (936us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789050167.110622:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00080000:0.0:1789050167.110881:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050167.114927:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050167.115147:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691592576 00000100:00100000:0.0:1789050167.115160:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691592576 00000100:00100000:0.0:1789050167.115276:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:0.0:1789050167.115288:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+22:2347:x1875954691592576:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050167.115320:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050167.115350:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a000 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce0 expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050167.115373:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:0.0:1789050167.115379:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050167.115447:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+21:2347:x1875954691592576:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 160us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050167.115455:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:3.0:1789050167.125891:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.126073:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691592832 00000100:00100000:2.0:1789050167.126086:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691592832 00000100:00100000:2.0:1789050167.126167:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050167.126179:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+21:14462:x1875954691592832:12345-192.168.206.1@tcp:35:cat.0 00000001:00080000:2.0:1789050167.126566:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934608 00000100:00100000:2.0:1789050167.127029:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14462:x1875954691592832:12345-192.168.206.1@tcp:35:cat.0 Request processed in 849us (1150us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1789050167.127039:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000020:00080000:2.0:1789050167.127045:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050167.182088:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050167.234511:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.234615:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691593088 00000100:00100000:2.0:1789050167.234628:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691593088 00000100:00100000:2.0:1789050167.234711:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:2.0:1789050167.234722:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14468:x1875954691593088:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:2.0:1789050167.234751:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050167.234776:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a00e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fce7 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.234901:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a015 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.234920:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.234934:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050167.234949:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050167.235138:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a00e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce7 expref: 26 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.235158:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a015 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce7 expref: 25 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.235168:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.235171:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050167.235175:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050167.235312:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+25:14468:x1875954691593088:12345-192.168.206.1@tcp:101:dd.0 Request processed in 592us (814us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789050167.235340:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:3.0:1789050167.241353:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050167.241535:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691593216 00000100:00100000:1.0:1789050167.241553:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691593216 00000100:00100000:1.0:1789050167.241648:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:1.0:1789050167.241660:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950605752c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+25:2350:x1875954691593216:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050167.241680:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050167.241723:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a015 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fce7 expref: 25 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.241746:0:16518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:1.0:1789050167.241752:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050167.241840:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950605752c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+24:2350:x1875954691593216:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 181us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050167.241848:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:3.0:1789050167.246618:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.246704:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691593472 00000100:00100000:2.0:1789050167.246714:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691593472 00000100:00100000:2.0:1789050167.246775:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:2.0:1789050167.246784:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+24:14468:x1875954691593472:12345-192.168.206.1@tcp:36:dd.0 00010000:00010000:2.0:1789050167.246832:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050167.246856:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b79fc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fccb expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.246874:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.246879:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050167.247426:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.247442:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.247453:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050167.247502:0:14402:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:2.0:1789050167.247526:0:14402:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000bf21130f reply state 0000000089463da1 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050167.247546:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050167.247702:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+26:14468:x1875954691593472:12345-192.168.206.1@tcp:36:dd.0 Request processed in 917us (1092us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789050167.247710:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000020:00080000:2.0:1789050167.247715:0:14402:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050167.252815:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252845:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252854:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252861:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050167.252866:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252874:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252891:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.252894:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050167.252900:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.252907:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a023 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050167.379918:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050167.380636:0:16631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691593728 00000100:00100000:1.0:1789050167.380661:0:16631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691593728 00000100:00100000:1.0:1789050167.380733:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:1.0:1789050167.380744:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+25:14468:x1875954691593728:12345-192.168.206.1@tcp:35:dd.0 00000100:00100000:1.0:1789050167.380980:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+26:14468:x1875954691593728:12345-192.168.206.1@tcp:35:dd.0 Request processed in 237us (1070us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789050167.380988:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789050167.699616:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.699941:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691593856 00000100:00100000:2.0:1789050167.699951:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691593856 00000100:00100000:2.0:1789050167.700023:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:2.0:1789050167.700033:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+26:14482:x1875954691593856:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:2.0:1789050167.700054:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050167.700072:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a02a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcee expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700162:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700174:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700184:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700227:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700235:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700242:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700326:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700334:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700340:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050167.700372:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789050167.700376:0:14403:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050167.700411:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700433:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700441:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700447:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700454:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700460:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050167.700464:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700471:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700482:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050167.700485:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050167.700490:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700495:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a031 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700508:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700514:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700526:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700531:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050167.700534:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700541:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700549:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95072c9b1600) 00010000:00010000:2.0:1789050167.700551:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050167.700553:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700558:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a038 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700589:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a02a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcee expref: 28 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700601:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcee expref: 27 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.700608:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.700609:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050167.700611:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50c00, rc 0) 00000100:00100000:2.0:1789050167.700670:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+27:14482:x1875954691593856:12345-192.168.206.1@tcp:101:stat.0 Request processed in 638us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050167.700686:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050167.796027:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050167.796250:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691594112 00000100:00100000:1.0:1789050167.796261:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691594112 00000100:00100000:1.0:1789050167.796371:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:1.0:1789050167.796381:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+27:14488:x1875954691594112:12345-192.168.206.1@tcp:36:truncate.0 00010000:00010000:1.0:1789050167.796428:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050167.796454:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50c00/0x9df728c939b7a03f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcee expref: 27 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.796473:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:1.0:1789050167.796477:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050167.796676:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.796690:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.796700:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050167.796750:0:14401:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:1.0:1789050167.796778:0:14401:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000004932032f reply state 00000000559f82d1 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050167.796803:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050167.796927:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+29:14488:x1875954691594112:12345-192.168.206.1@tcp:36:truncate.0 Request processed in 547us (907us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789050167.796935:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00000020:00080000:1.0:1789050167.796940:0:14401:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050167.801598:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801613:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801621:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801626:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050167.801630:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801636:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801652:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:1.0:1789050167.801655:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050167.801659:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050167.801664:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a046 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050167.948107:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050167.948227:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691594240 00000100:00100000:2.0:1789050167.948236:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691594240 00000100:00100000:2.0:1789050167.948310:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:2.0:1789050167.948320:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+28:14502:x1875954691594240:12345-192.168.206.1@tcp:101:stat.0 00010000:00010000:2.0:1789050167.948344:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050167.948363:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a04d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcf5 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948426:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948439:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948450:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948464:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948471:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948478:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948558:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948589:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948596:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050167.948627:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789050167.948631:0:14403:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050167.948648:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948659:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948667:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948673:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948679:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948685:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050167.948689:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948696:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948707:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050167.948715:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050167.948721:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948727:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a054 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948739:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948745:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948750:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948755:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050167.948758:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948764:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948771:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95072c9b1600) 00010000:00010000:2.0:1789050167.948774:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050167.948776:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948782:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a05b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948812:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a04d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 30 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948837:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 29 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050167.948844:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050167.948846:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789050167.948848:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050167.948905:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+29:14502:x1875954691594240:12345-192.168.206.1@tcp:101:stat.0 Request processed in 586us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050167.948913:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:3.0:1789050168.010128:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.011318:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691594496 00000100:00100000:2.0:1789050168.011331:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691594496 00000100:00100000:2.0:1789050168.011553:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789050168.011568:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+29:14512:x1875954691594496:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050168.011599:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.011619:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fcfc expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050168.011698:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050168.012331:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a069 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcfc expref: 31 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.012349:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050168.012352:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050168.012359:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcfc expref: 31 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.012710:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050168.012777:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+30:14512:x1875954691594496:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1212us (2656us total) trans 8589934616 rc 301/301 00000100:00100000:3.0:1789050168.018449:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.019053:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691594752 00000100:00100000:0.0:1789050168.019075:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691594752 00000100:00100000:0.0:1789050168.019134:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789050168.019144:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507101b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+31:14512:x1875954691594752:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:0.0:1789050168.019397:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507101b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+32:14512:x1875954691594752:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 253us (955us total) trans 8589934617 rc 0/0 00000100:00100000:0.0:1789050168.019404:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050168.025135:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:3.0:1789050168.113839:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.114024:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595008 00000100:00100000:2.0:1789050168.114034:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595008 00000100:00100000:2.0:1789050168.114097:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:2.0:1789050168.114107:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+31:14518:x1875954691595008:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050168.114129:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.114150:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a077 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd03 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.114287:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.114300:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.114307:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 32 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.114315:0:14403:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.114667:0:14403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 32 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.114724:0:14403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 32 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.114739:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1875954704157696:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050168.114892:0:14403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.114920:0:14403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.114929:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1875954704157824:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050168.114954:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f77240 going to sleep for 11 seconds 00000100:00100000:3.0:1789050168.117091:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1875954704157696:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050168.117104:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1875954704157824:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050168.117128:0:14403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.119967:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050168.120021:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.120128:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595136 00000100:00100000:2.0:1789050168.120138:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595136 00010000:00010000:2.0:1789050168.120180:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 33 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.120264:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595264 00000100:00100000:2.0:1789050168.120269:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595264 00010000:00010000:2.0:1789050168.120284:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 34 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.120316:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050168.120326:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+34:2348:x1875954691595136:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050168.120339:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050168.120345:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 34 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120363:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 34 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120384:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a062 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcf5 expref: 34 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120398:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050168.120403:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120411:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120417:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050168.120462:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+33:2348:x1875954691595136:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 137us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.120478:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050168.120497:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:2.0:1789050168.120504:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+32:2348:x1875954691595264:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050168.120514:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050168.120520:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120530:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120542:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b79fb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcc4 expref: 32 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120551:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050168.120555:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120562:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120569:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.120589:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050168.120609:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+31:2348:x1875954691595264:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 105us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.120616:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00010000:00010000:3.0:1789050168.120690:0:14403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.120699:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050168.120717:0:14403:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789050168.120858:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a077 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 32 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.120875:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 31 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.120883:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:3.0:1789050168.120892:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050168.120895:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50400, rc 0) 00000100:00100000:3.0:1789050168.120920:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+31:14518:x1875954691595008:12345-192.168.206.1@tcp:101:bash.0 Request processed in 6814us (7088us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789050168.120926:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:0.0:1789050168.126511:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.126609:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595520 00000100:00100000:1.0:1789050168.126630:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595520 00000100:00100000:1.0:1789050168.126689:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:1.0:1789050168.126700:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+31:14518:x1875954691595520:12345-192.168.206.1@tcp:36:bash.0 00010000:00010000:1.0:1789050168.126928:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.126943:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.126955:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789050168.127011:0:14401:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000004:00010000:1.0:1789050168.127035:0:14401:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000008b8aa80f reply state 00000000783ba33d transno 8589934620 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050168.127044:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050168.127300:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+34:14518:x1875954691595520:12345-192.168.206.1@tcp:36:bash.0 Request processed in 601us (796us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789050168.127309:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000020:00080000:1.0:1789050168.127314:0:14401:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789050168.129319:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:2.0:1789050168.129447:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129459:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129466:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129471:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050168.129475:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129483:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129498:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050168.129500:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050168.129505:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.129511:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531800/0x9df728c939b7a08c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050168.129880:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595648 00000100:00100000:0.0:1789050168.129888:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595648 00000100:00100000:0.0:1789050168.129930:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:0.0:1789050168.129939:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+33:14518:x1875954691595648:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:0.0:1789050168.129959:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050168.129974:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a093 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd0a expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.130037:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd0a expref: 34 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.130161:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a093 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd0a expref: 34 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.130182:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:0.0:1789050168.130185:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789050168.130187:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:0.0:1789050168.130461:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+34:14518:x1875954691595648:12345-192.168.206.1@tcp:101:bash.0 Request processed in 522us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.130469:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:3.0:1789050168.138832:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.139121:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595776 00000100:00100000:2.0:1789050168.139131:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595776 00000100:00100000:2.0:1789050168.139281:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:2.0:1789050168.139292:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+34:14518:x1875954691595776:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050168.139320:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.139340:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7a09a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd11 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.139440:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.139455:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 35 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.139463:0:14402:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.139492:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 35 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.139505:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 35 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.139518:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875954704157952:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050168.139789:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050168.142043:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875954704157952:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050168.142074:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.142974:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.143118:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691595904 00000100:00100000:2.0:1789050168.143129:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691595904 00010000:00010000:2.0:1789050168.143169:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 36 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.143304:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789050168.143329:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+36:2347:x1875954691595904:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050168.143344:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050168.143352:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 36 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143364:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 36 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143385:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a07e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd03 expref: 36 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143399:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:2.0:1789050168.143404:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143414:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143421:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.143458:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050168.143512:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+35:2347:x1875954691595904:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 185us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.143521:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00010000:00010000:1.0:1789050168.143539:0:14402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.143550:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050168.143592:0:14402:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789050168.143596:0:14402:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050168.143615:0:14402:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.143652:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50a00/0x9df728c939b7a09a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd11 expref: 35 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.143667:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd11 expref: 34 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.143674:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:1.0:1789050168.143677:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050168.143694:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:1.0:1789050168.143744:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+34:14518:x1875954691595776:12345-192.168.206.1@tcp:101:bash.0 Request processed in 4447us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.143752:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:2.0:1789050168.150290:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.150616:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596160 00000100:00100000:0.0:1789050168.150626:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596160 00000100:00100000:0.0:1789050168.150730:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:0.0:1789050168.150740:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+34:14518:x1875954691596160:12345-192.168.206.1@tcp:103:bash.0 00010000:00010000:0.0:1789050168.150755:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789050168.150779:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a0a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd11 expref: 34 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.150799:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a093 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd0a expref: 33 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.150810:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1e00) 00010000:00010000:0.0:1789050168.150821:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050168.150878:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+32:14518:x1875954691596160:12345-192.168.206.1@tcp:103:bash.0 Request processed in 139us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.150885:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:0.0:1789050168.155597:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.155707:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596288 00000100:00100000:2.0:1789050168.155716:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596288 00000100:00100000:2.0:1789050168.155773:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:2.0:1789050168.155797:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+32:14518:x1875954691596288:12345-192.168.206.1@tcp:58:bash.0 00010000:00010000:2.0:1789050168.156021:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.156038:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.156063:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050168.157993:0:16279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050168.158162:0:16279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789050168.158541:0:16279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789050168.158655:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+32:14518:x1875954691596288:12345-192.168.206.1@tcp:58:bash.0 Request processed in 2856us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.158666:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:3.0:1789050168.164291:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.164400:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596416 00000100:00100000:1.0:1789050168.164409:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596416 00000100:00100000:1.0:1789050168.164472:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:1.0:1789050168.164482:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+32:14518:x1875954691596416:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050168.164501:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050168.164520:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd18 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164571:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164583:0:14401:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 33 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164600:0:14401:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164624:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 33 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164637:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:1.0:1789050168.164640:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050168.164644:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 33 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.164651:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c531e00, rc 0) 00000100:00100000:1.0:1789050168.164710:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+33:14518:x1875954691596416:12345-192.168.206.1@tcp:101:bash.0 Request processed in 230us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.164717:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00010000:00010000:0.0:1789050168.203481:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789050168.493052:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934617 is committed 00000001:00080000:0.0:1789050168.493069:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789050168.493079:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1789050168.493137:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:2.0:1789050168.588079:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050168.588089:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050168.588155:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789050168.588163:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789050168.588381:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14435:1875954704158080:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050168.588535:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050168.605370:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14435:1875954704158080:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789050168.609933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.609992:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596544 00000100:00100000:0.0:1789050168.610013:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596544 00000100:00100000:0.0:1789050168.610118:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:0.0:1789050168.610129:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596544:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789050168.610263:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596544:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 Request processed in 135us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.610286:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050168.614116:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.614324:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596672 00000100:00100000:0.0:1789050168.614334:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596672 00000100:00100000:0.0:1789050168.614387:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:0.0:1789050168.614396:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596672:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789050168.614424:0:14403:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789050168.614536:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596672:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 133us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.614543:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:3.0:1789050168.623470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.624833:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691596800 00000100:00100000:1.0:1789050168.624846:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691596800 00000100:00100000:1.0:1789050168.624909:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789050168.624918:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596800:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789050168.624982:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625007:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625019:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625070:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625089:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625097:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625117:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625124:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625130:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789050168.625165:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789050168.625168:0:14401:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789050168.625181:0:14401:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625191:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625196:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625246:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625252:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050168.625256:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625268:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625280:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950714b52a00) 00010000:00010000:1.0:1789050168.625283:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050168.625288:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625294:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a0b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625308:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625314:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625320:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625325:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050168.625328:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625334:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625341:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff950732cb4900) 00010000:00010000:1.0:1789050168.625343:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050168.625346:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625360:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a0bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625376:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625382:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625387:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625392:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050168.625395:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625405:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625413:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:1.0:1789050168.625415:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050168.625418:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.625423:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050168.625496:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691596800:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 578us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.625504:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789050168.631868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.632015:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691597056 00000100:00100000:2.0:1789050168.632024:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691597056 00000100:00100000:2.0:1789050168.632078:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:2.0:1789050168.632089:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+10:14519:x1875954691597056:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.632108:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.632139:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd1f expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632404:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632418:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632429:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050168.632441:0:16279:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789050168.632550:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632559:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632566:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632572:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050168.632576:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632583:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632594:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:2.0:1789050168.632597:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050168.632601:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632617:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632659:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd1f expref: 12 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632669:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950714b52a00) 00010000:00010000:2.0:1789050168.632672:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050168.632676:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd1f expref: 12 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.632685:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50000, rc 0) 00000100:00100000:2.0:1789050168.632752:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14519:x1875954691597056:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 665us (893us total) trans 8589934621 rc 301/301 00000100:00100000:2.0:1789050168.632760:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:1.0:1789050168.639494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.642844:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691597184 00000100:00100000:2.0:1789050168.642859:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691597184 00000100:00100000:2.0:1789050168.642933:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:2.0:1789050168.642942:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14519:x1875954691597184:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789050168.642975:0:14401:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789050168.643080:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14519:x1875954691597184:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 138us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.643087:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:3.0:1789050168.652669:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.652887:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691597440 00000100:00100000:0.0:1789050168.652897:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691597440 00000100:00100000:0.0:1789050168.653006:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:0.0:1789050168.653016:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14519:x1875954691597440:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050168.653034:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050168.653050:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a0e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd26 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789050168.654375:0:14403:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1789050168.654384:0:14403:0:(osp_object.c:1650:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789050168.654450:0:14403:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789050168.655969:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.655987:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.656009:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.656086:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a0e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd26 expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.656104:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd26 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.656113:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff950732cb4900) 00010000:00010000:1.0:1789050168.656116:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789050168.656119:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073c530400, rc 0) 00000100:00100000:1.0:1789050168.656176:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691597440:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 3162us (3517us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789050168.656184:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:0.0:1789050168.670820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.670913:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691597696 00000100:00100000:2.0:1789050168.670922:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691597696 00000100:00100000:2.0:1789050168.670981:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:2.0:1789050168.671014:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691597696:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.671066:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050168.671089:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530400/0x9df728c939b7a0e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd26 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671108:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff950732cb4900) 00010000:00010000:2.0:1789050168.671122:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050168.671143:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671154:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671165:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671177:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671183:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671189:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671416:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671425:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671439:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671444:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050168.671448:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671455:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671463:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:2.0:1789050168.671466:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050168.671469:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671475:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a0f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671483:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671489:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671494:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671498:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050168.671500:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671516:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671524:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6871202b (ffff95072c9b1b00) 00010000:00010000:2.0:1789050168.671527:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050168.671530:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.671535:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a0fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6871202b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.671618:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+12:14519:x1875954691597696:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 606us (805us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050168.671626:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:3.0:1789050168.681306:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.681363:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691597824 00000100:00100000:2.0:1789050168.681372:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691597824 00000100:00100000:2.0:1789050168.681427:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:2.0:1789050168.681437:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+12:14519:x1875954691597824:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.681454:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.681475:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a103 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd2d expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681509:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a10a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681522:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681533:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681628:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a103 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd2d expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681645:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd2d expref: 13 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.681653:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050168.681655:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789050168.681658:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51c00, rc 0) 00000100:00100000:2.0:1789050168.681705:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691597824:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 269us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.681712:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:2.0:1789050168.689778:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.689894:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598080 00000100:00100000:1.0:1789050168.689903:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598080 00000100:00100000:1.0:1789050168.689960:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:1.0:1789050168.689971:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691598080:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050168.690065:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.690081:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.690094:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050168.690571:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789050168.690581:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404678380334ns, next at 405678378587ns, rc = 0 00000004:00010000:1.0:1789050168.690653:0:14401:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000bbe89c86 reply state 00000000e735c2da transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050168.690662:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050168.690748:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+15:14519:x1875954691598080:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 778us (977us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789050168.690756:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:0.0:1789050168.696007:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.696094:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598208 00000100:00100000:2.0:1789050168.696103:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598208 00000100:00100000:2.0:1789050168.696161:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 54 00000100:00100000:2.0:1789050168.696171:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+15:14519:x1875954691598208:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.696194:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.696249:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd34 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.696305:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 16 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.696320:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 16 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.696358:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050168.696362:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050168.696365:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050168.696415:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14519:x1875954691598208:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 244us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.696422:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 54 00010000:00010000:1.0:1789050168.696942:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.696952:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.696958:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.696964:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050168.696969:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.696989:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.697009:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050168.697012:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789050168.697016:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.697021:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c530c00/0x9df728c939b7a111 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.706302:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.706479:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598336 00000100:00100000:2.0:1789050168.706489:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598336 00000100:00100000:2.0:1789050168.706558:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050168.706578:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2348:x1875954691598336:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789050168.706904:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2348:x1875954691598336:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 337us (610us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789050168.706913:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00080000:1.0:1789050168.707055:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789050168.717318:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.719344:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598592 00000100:00100000:2.0:1789050168.719357:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598592 00000100:00100000:2.0:1789050168.719428:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050168.719438:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+15:14519:x1875954691598592:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789050168.719717:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14519:x1875954691598592:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 280us (2406us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1789050168.719737:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789050168.728145:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.728257:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598848 00000100:00100000:1.0:1789050168.728266:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598848 00000100:00100000:1.0:1789050168.728327:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:1.0:1789050168.728337:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14519:x1875954691598848:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789050168.728436:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14519:x1875954691598848:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.728444:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 55 00000100:00100000:3.0:1789050168.731782:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.731860:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691598976 00000100:00100000:2.0:1789050168.731869:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691598976 00000100:00100000:2.0:1789050168.731925:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:2.0:1789050168.731935:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+16:14519:x1875954691598976:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.731969:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.731989:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a11f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd3b expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732064:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732077:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732088:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050168.732123:0:16279:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050168.732140:0:16279:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732164:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a11f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd3b expref: 18 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732181:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd3b expref: 17 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.732189:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050168.732192:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789050168.732196:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50000, rc 0) 00000100:00100000:0.0:1789050168.732535:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14519:x1875954691598976:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 600us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.732543:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 56 00000100:00100000:0.0:1789050168.737989:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.738102:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691599104 00000100:00100000:2.0:1789050168.738111:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691599104 00000100:00100000:2.0:1789050168.738163:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050168.738173:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2348:x1875954691599104:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.738236:0:16630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.738264:0:16630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd42 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050168.738293:0:16630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fba67bd63e40, blocks: 0x1 00010000:00010000:2.0:1789050168.738312:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1789050168.738317:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050168.738549:0:16630:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 7 pid: 16630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.738571:0:16630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 7 pid: 16630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.738584:0:16630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51600, rc 0) 00000100:00100000:2.0:1789050168.738682:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2348:x1875954691599104:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 510us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.738690:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050168.743478:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.743529:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691599360 00000100:00100000:1.0:1789050168.743539:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691599360 00000100:00100000:1.0:1789050168.743592:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:1.0:1789050168.743601:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14519:x1875954691599360:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789050168.743700:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14519:x1875954691599360:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.743707:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 57 00000100:00100000:3.0:1789050168.748160:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.748318:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691599488 00000100:00100000:1.0:1789050168.748338:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691599488 00000100:00100000:1.0:1789050168.748394:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00100000:1.0:1789050168.748476:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14519:x1875954691599488:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789050168.819646:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:1.0:1789050168.819661:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000004:00080000:1.0:1789050168.819666:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789050168.819677:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000100:00100000:1.0:1789050168.819776:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704158208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789050168.819833:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050168.819905:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158208 00000100:00100000:1.0:1789050168.819912:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158208 00000100:00100000:1.0:1789050168.819963:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050168.819971:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704158208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789050168.820649:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691599488:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 72242us (72493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050168.820658:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 58 00000100:00080000:0.0:1789050168.821982:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789050168.829314:0:15086:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789050168.829323:0:15086:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789050168.829325:0:15086:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789050168.829327:0:15086:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789050169457000000 -> 1789050169457000000 00002000:00010000:1.0:1789050168.829330:0:15086:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789050168.829431:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704158208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 9457us (9594us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789050168.829440:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1789050168.829650:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073cd6fb80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789050168.829658:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704158208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789050168.834183:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050168.840046:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691599616 00000100:00100000:3.0:1789050168.840060:0:15848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691599616 00000100:00100000:3.0:1789050168.840140:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050168.840149:0:15848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2347:x1875954691599616:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789050168.840281:0:15848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2347:x1875954691599616:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 132us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050168.840288:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789050168.844649:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.844798:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691599872 00000100:00100000:1.0:1789050168.844808:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691599872 00000100:00100000:1.0:1789050168.844863:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:1.0:1789050168.844873:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691599872:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050168.844919:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050168.844944:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a126 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd3b expref: 13 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.844973:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050168.844978:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789050168.845019:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.845031:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.845041:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789050168.846363:0:14402:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a04a9aa8 reply state 00000000d0ae2076 transno 8589934625 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050168.846389:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050168.846540:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+14:14519:x1875954691599872:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 1665us (1897us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1789050168.846549:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 59 00000100:00100000:1.0:1789050168.853633:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:2.0:1789050168.853916:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.853928:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.853949:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.853956:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050168.853960:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.853969:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.853984:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:2.0:1789050168.853987:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050168.853992:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.854009:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531000/0x9df728c939b7a134 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050168.854179:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600000 00000100:00100000:0.0:1789050168.854188:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600000 00000100:00100000:0.0:1789050168.854261:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050168.854270:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+7:14519:x1875954691600000:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050168.854285:0:16630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050168.854513:0:16630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd49 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.854540:0:16630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 8 pid: 16630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.854549:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050168.854554:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050168.854559:0:16630:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.854596:0:16630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 8 pid: 16630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.854610:0:16630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 8 pid: 16630 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050168.854623:0:16630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16630:1875954704158336:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050168.854701:0:16630:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050168.862086:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050168.863145:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600128 00000100:00100000:3.0:1789050168.863156:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600128 00010000:00010000:3.0:1789050168.863497:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 9 pid: 16630 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.863542:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:3.0:1789050168.863552:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+9:2347:x1875954691600128:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050168.863566:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050168.863589:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 9 pid: 16630 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.863602:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 9 pid: 16630 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.863627:0:14386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050168.863631:0:14386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050168.863638:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.863648:0:14386:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.863695:0:14386:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.863709:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14386:1875954704158464:192.168.206.1@tcp:105: 00000100:00100000:3.0:1789050168.863874:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789050168.865314:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a12d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd42 expref: 9 pid: 16630 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050168.865351:0:16630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16630:1875954704158336:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050168.865381:0:16630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.865393:0:16630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330200, rc 0) 00000100:00100000:0.0:1789050168.865442:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+8:14519:x1875954691600000:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 11172us (11816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.865450:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789050168.870537:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.870753:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600256 00000100:00100000:1.0:1789050168.870763:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600256 00000100:00100000:1.0:1789050168.870817:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:1.0:1789050168.870827:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2347:x1875954691600256:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789050168.871014:0:15088:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789050168.871018:0:15088:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789050168894000000 00002000:00010000:1.0:1789050168.871021:0:15088:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789050167221471006 00002000:00010000:1.0:1789050168.871023:0:15088:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789050169457000000 -> 1789050168894000000 00002000:00010000:1.0:1789050168.871040:0:15088:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789050168.871102:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+9:2347:x1875954691600256:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 276us (572us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789050168.871110:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050168.874649:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14386:1875954704158464:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050168.874678:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050168.874942:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.875082:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2347:x1875954691600128:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 11529us (13001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.875093:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:3.0:1789050168.877170:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600384 00000100:00100000:3.0:1789050168.877183:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600384 00000100:00100000:2.0:1789050168.877671:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:2.0:1789050168.877682:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2348:x1875954691600384:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.877723:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.877759:0:15087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.877768:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050168.877772:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050168.877776:0:15087:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.877810:0:15087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.877824:0:15087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 8 pid: 16630 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.877839:0:15087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15087:1875954704158592:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050168.877934:0:15087:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789050168.883084:0:15087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15087:1875954704158592:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050168.883115:0:15087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050168.884631:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050168.885135:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600512 00000100:00100000:1.0:1789050168.885144:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600512 00010000:00010000:1.0:1789050168.885177:0:16518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050168.885240:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:1.0:1789050168.885250:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+9:2348:x1875954691600512:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050168.885281:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050168.885319:0:16518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.885333:0:16518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.885355:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d79c038/0x9df728c939b7a13b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd49 expref: 9 pid: 16630 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.885528:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050168.885533:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789050168.885538:0:16518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.885559:0:16518:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.885609:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050168.885669:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2348:x1875954691600512:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 420us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.885676:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00010000:00010000:2.0:1789050168.886613:0:15087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886628:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886667:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886675:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886695:0:15087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886702:0:15087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050168.886705:0:15087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886713:0:15087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886728:0:15087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.886736:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000636ddd63/0x9df728c939b7a142 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.886808:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+7:2348:x1875954691600384:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 9125us (11865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.886825:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050168.892051:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.892135:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600768 00000100:00100000:2.0:1789050168.892144:0:16279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600768 00000100:00100000:2.0:1789050168.892220:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 60 00000100:00100000:2.0:1789050168.892231:0:16279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+13:14519:x1875954691600768:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789050168.892303:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892319:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892330:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892556:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892577:0:16279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892588:0:16279:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892630:0:16279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.892644:0:16279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 14 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.892670:0:16279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704158720:192.168.206.1@tcp:104: 00000100:00100000:2.0:1789050168.892751:0:16279:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070641e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789050168.900892:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050168.901383:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691600896 00000100:00100000:3.0:1789050168.901392:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691600896 00010000:00010000:3.0:1789050168.901430:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 15 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.901473:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:3.0:1789050168.901484:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950605753c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+15:2348:x1875954691600896:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050168.901498:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050168.901504:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 15 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.901517:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 15 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.901537:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050168.901543:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.901553:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.901560:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.901584:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050168.901649:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950605753c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+15:2348:x1875954691600896:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 166us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050168.901657:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00010000:00010000:2.0:1789050168.902877:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50e00/0x9df728c939b7a118 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd34 expref: 14 pid: 16279 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050168.902898:0:16279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704158720:192.168.206.1@tcp:104: 00010000:00010000:2.0:1789050168.902917:0:16279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.902926:0:16279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.902931:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050168.903107:0:16279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:2.0:1789050168.903474:0:16279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1789050168.903522:0:16279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:2.0:1789050168.903891:0:16279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16279:1875954704158848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050168.903971:0:16279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050168.904343:0:16279:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050168.906595:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158848 00000100:00100000:0.0:1789050168.906607:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158848 00000100:00100000:0.0:1789050168.906664:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050168.906674:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16279:x1875954704158848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050168.907005:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16279:x1875954704158848:12345-0@lo:1000:mdt00_003.0 Request processed in 323us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050168.907013:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050168.907240:0:16279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16279:1875954704158848:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789050168.909552:0:16279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1789050168.910192:0:16279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16279:1875954704158976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789050168.910649:0:16279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050168.910782:0:16279:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050168.911061:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704158976 00000100:00100000:0.0:1789050168.911069:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704158976 00000100:00100000:0.0:1789050168.911152:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050168.911162:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16279:x1875954704158976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789050168.911428:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16279:x1875954704158976:12345-0@lo:1000:mdt00_003.0 Request processed in 267us (779us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789050168.911442:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050168.911527:0:16279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9507033d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16279:1875954704158976:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789050168.911561:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911579:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911587:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911593:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050168.911597:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911605:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911620:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:3.0:1789050168.911623:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050168.911628:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911635:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50000/0x9df728c939b7a150 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911664:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911678:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911695:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911699:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050168.911702:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911707:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911715:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:3.0:1789050168.911717:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050168.911724:0:16279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911733:0:16279:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911741:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.911801:0:16279:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.911812:0:16279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704159104:192.168.206.1@tcp:105: 00000100:00100000:3.0:1789050168.911888:0:16279:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704ed1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050168.918580:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050168.918591:0:16279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875954704159104:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050168.918622:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918633:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50400/0x9df728c939b7a0a8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918666:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918679:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918690:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918699:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918704:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918710:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918715:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050168.918719:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918726:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918756:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:3.0:1789050168.918759:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050168.918763:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918768:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a157 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918777:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918783:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918789:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918804:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050168.918807:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918812:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918819:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:3.0:1789050168.918821:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789050168.918824:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050168.918828:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51600/0x9df728c939b7a149 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050168.919056:0:16279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14519:x1875954691600768:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 26826us (27012us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1789050168.919067:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 60 00000020:00080000:3.0:1789050168.919072:0:16279:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789050168.919724:0:16631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691601024 00000100:00100000:1.0:1789050168.919732:0:16631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691601024 00000100:00100000:1.0:1789050168.919778:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:1.0:1789050168.919787:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14518:x1875954691601024:12345-192.168.206.1@tcp:49:bash.0 00000100:00100000:1.0:1789050168.919893:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14518:x1875954691601024:12345-192.168.206.1@tcp:49:bash.0 Request processed in 106us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050168.919900:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000040:00080000:2.0:1789050168.921920:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050168.921928:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050168.921958:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789050168.921977:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789050168.925668:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050168.926247:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691601152 00000100:00100000:2.0:1789050168.926258:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691601152 00000100:00100000:2.0:1789050168.926304:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050168.926313:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+7:14518:x1875954691601152:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050168.926328:0:16630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050168.926348:0:16630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b7a15e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd50 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050168.926389:0:16630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x18d3fba65a478b80, atime: 0x18d3fba5f696c71e, ctime: 0x18d3fba65a478b80, blocks: 0x1 00010000:00010000:2.0:1789050168.926407:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1789050168.926412:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050168.926421:0:16630:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b7a15e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd50 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.926437:0:16630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b7a15e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd50 expref: 8 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050168.926450:0:16630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050168.926504:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:66ca7618-37f8-428a-932b-a194d1b4ace8+8:14518:x1875954691601152:12345-192.168.206.1@tcp:101:bash.0 Request processed in 192us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050168.926511:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:1.0:1789050168.931335:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.931475:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691601408 00000100:00100000:0.0:1789050168.931485:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691601408 00000100:00100000:0.0:1789050168.931544:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:0.0:1789050168.931554:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+17:14518:x1875954691601408:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:0.0:1789050168.931791:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1789050168.931903:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1789050168.932014:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+20:14518:x1875954691601408:12345-192.168.206.1@tcp:35:bash.0 Request processed in 460us (686us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1789050168.932021:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000020:00080000:0.0:1789050168.932026:0:14404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789050168.932498:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050168.935649:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691601664 00000100:00100000:0.0:1789050168.935663:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691601664 00000100:00100000:0.0:1789050168.935749:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050168.935760:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+20:14519:x1875954691601664:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789050168.936928:0:14405:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789050168.937036:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934634 00010000:00010000:0.0:1789050168.937090:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937106:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937118:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937138:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937145:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937152:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050168.937259:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789050168.937377:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+22:14519:x1875954691601664:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 1608us (4868us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789050168.937385:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000020:00080000:0.0:1789050168.937391:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789050168.943954:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050168.943967:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.943977:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050168.943981:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.944519:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.944565:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050168.944569:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789050168.944574:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.944580:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a165 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050168.944595:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050168.944597:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050168.944599:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050169.023587:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050169.023693:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691601920 00000100:00100000:2.0:1789050169.023703:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691601920 00000100:00100000:2.0:1789050169.023779:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050169.023789:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+22:14529:x1875954691601920:12345-192.168.206.1@tcp:101:lfs.0 00000100:00080000:0.0:1789050169.024232:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050169.025033:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050169.025064:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a16c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd57 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050169.025283:0:14401:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789050169.025455:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a16c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd57 expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050169.025469:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:2.0:1789050169.025473:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789050169.025477:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51200/0x9df728c939b7a16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd57 expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050169.025492:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51200, rc 0) 00000100:00100000:2.0:1789050169.025610:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14529:x1875954691601920:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 1814us (2024us total) trans 8589934636 rc 301/301 00000100:00100000:2.0:1789050169.025619:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 61 00000100:00100000:2.0:1789050169.039442:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050169.039584:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602048 00000100:00100000:3.0:1789050169.039593:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602048 00000100:00100000:3.0:1789050169.039653:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:3.0:1789050169.039664:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14529:x1875954691602048:12345-192.168.206.1@tcp:34:lfs.0 00010000:00010000:3.0:1789050169.039730:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.039745:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.039758:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.039774:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.039781:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.039788:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040022:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040031:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040046:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789050169.040082:0:14403:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040501:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040509:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040516:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040522:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050169.040526:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040534:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040546:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:3.0:1789050169.040549:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050169.040554:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040560:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e200/0x9df728c939b7a17a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040627:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040640:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040646:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040651:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05e400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050169.040653:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040660:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040668:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9507102a3500) 00010000:00010000:3.0:1789050169.040670:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050169.040673:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040678:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e400/0x9df728c939b7a181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040693:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040699:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040705:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040709:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95070f05f200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050169.040718:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040725:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040732:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:3.0:1789050169.040735:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050169.040738:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050169.040743:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f200/0x9df728c939b7a188 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050169.040917:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14529:x1875954691602048:12345-192.168.206.1@tcp:34:lfs.0 Request processed in 1252us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050169.040927:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 62 00000100:00100000:0.0:1789050169.064770:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050169.064879:0:16631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602304 00000100:00100000:3.0:1789050169.064889:0:16631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602304 00000100:00100000:3.0:1789050169.064945:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050169.064954:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+23:14529:x1875954691602304:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050169.065258:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+24:14529:x1875954691602304:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 304us (1397us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1789050169.065267:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00010000:00010000:2.0:1789050169.227513:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050169.483940:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704159360:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484063:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704159872:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484088:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484115:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050169.484121:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704159488:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484142:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484166:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704159616:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484187:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484222:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789050169.484228:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704159232:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484279:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484306:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704159744:0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484316:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050169.484330:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050169.484356:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050169.484356:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704160128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050169.484394:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160000 00000100:00100000:0.0:1789050169.484399:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050169.484401:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160000 00000100:00100000:0.0:1789050169.484440:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160128 00000100:00100000:0.0:1789050169.484446:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160128 00000100:00100000:1.0:1789050169.484452:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789050169.484463:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704160000:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050169.484476:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159872 00000100:00100000:0.0:1789050169.484480:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159872 00002000:00000024:1.0:1789050169.484496:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050169.484510:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159616 00000100:00100000:0.0:1789050169.484514:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159616 00000100:00100000:0.0:1789050169.484531:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159744 00000100:00100000:0.0:1789050169.484535:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159744 00000100:00100000:1.0:1789050169.484545:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704160000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050169.484552:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050169.484554:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050169.484563:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704159872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484577:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050169.484585:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875954704160128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050169.484605:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050169.484612:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704159872:12345-0@lo:400:kworker.0 Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050169.484620:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789050169.484636:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789050169.484646:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875954704160128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050169.484647:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484667:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789050169.484689:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704159616:12345-0@lo:400:kworker.0 Request processed in 44us (499us total) trans 0 rc 0/0 00000100:00080000:1.0:1789050169.484691:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050169.484697:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050169.484698:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050169.484717:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789050169.484724:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484730:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050169.484755:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704159744:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050169.484763:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704159872:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484770:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050169.484786:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159360 00000100:00100000:1.0:1789050169.484791:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159360 00000100:00100000:0.0:1789050169.484819:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159488 00000100:00100000:1.0:1789050169.484823:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050169.484824:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159488 00000100:00100000:1.0:1789050169.484832:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704159360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484854:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789050169.484862:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484893:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704159360:12345-0@lo:400:kworker.0 Request processed in 61us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050169.484901:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704159488:12345-0@lo:400:kworker.0 Request processed in 38us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050169.484902:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050169.484912:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050169.484936:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704159488:0@lo:400:kworker.0 00000100:00100000:1.0:1789050169.484948:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704159360:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.484971:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704160128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050169.484986:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704159744:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.485009:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704159616:0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.485038:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704159232 00000100:00100000:0.0:1789050169.485042:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704159232 00000100:00100000:0.0:1789050169.485066:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789050169.485071:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704159232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050169.485103:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704159232:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050169.485108:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789050169.485138:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704159232:0@lo:400:kworker.0 00000040:00080000:2.0:1789050169.931457:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050169.931465:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050169.931496:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789050169.931502:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789050170.253116:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050170.802574:0:16671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1789050171.086852:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.086927:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.086955:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.086978:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.087009:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.087027:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.087064:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050171.087088:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602688 00000100:00100000:2.0:1789050171.087096:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602688 00000100:00100000:2.0:1789050171.087140:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603200 00000100:00100000:2.0:1789050171.087142:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603200 00000100:00100000:2.0:1789050171.087154:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602816 00000100:00100000:2.0:1789050171.087156:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602816 00000100:00100000:2.0:1789050171.087165:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603072 00000100:00100000:2.0:1789050171.087167:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603072 00000100:00100000:2.0:1789050171.087179:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789050171.087187:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2349:x1875954691602688:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087280:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2349:x1875954691602688:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087288:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789050171.087303:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789050171.087309:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2349:x1875954691603200:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087334:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2349:x1875954691603200:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087340:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789050171.087351:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:2.0:1789050171.087357:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2349:x1875954691602816:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087378:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2349:x1875954691602816:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087383:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:2.0:1789050171.087392:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050171.087397:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2349:x1875954691603072:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087427:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2349:x1875954691603072:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087432:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050171.087452:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602944 00000100:00100000:2.0:1789050171.087456:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602944 00000100:00100000:2.0:1789050171.087483:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602560 00000100:00100000:2.0:1789050171.087487:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602560 00000100:00100000:2.0:1789050171.087508:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:2.0:1789050171.087515:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691602944:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087545:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691602944:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087551:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:2.0:1789050171.087563:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:2.0:1789050171.087569:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+24:2349:x1875954691602560:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050171.087594:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+24:2349:x1875954691602560:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050171.087599:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00080000:2.0:1789050171.087620:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050171.087631:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050171.087633:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050171.093054:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691602432 00000100:00100000:0.0:1789050171.093068:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691602432 00000100:00100000:0.0:1789050171.093139:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 123 00000100:00100000:0.0:1789050171.093163:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507052bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2349:x1875954691602432:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050171.093254:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507052bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2349:x1875954691602432:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 93us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050171.093261:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 123 00010000:00010000:1.0:1789050171.275931:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050172.301838:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29096 lines, 29096 kept, 0 dropped, 0 bad.